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This  report  provides  an  annotated  bibliography  of  references  relating  to  human/com¬ 
puter  tranMctions.  Operator-^analyst  and  software  programmer  roles  are  represented  by 
the  majority  of  the  references.  Tidies  covered  include  display  formatting,  error 
modeling,  performance  assessment,  query  languages,  keyboard  anid  data  entry,  itota 
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FOREWORD 


This  selected  annotated  bibliography  was  developed  by  the  Virginia  Polytechnic 
Institute  and  State  University  under  contract  N00123-77-C-1081  in  support  of  project 
Z1170-PN  (Human  Processing  of  Large  Automated  Data  Base),  subproject  Z1170.PN.03 
(improving  the  accuracy  and  usability  of  automated  personnel  information  systems).  The 
wo^  was  sponsored  by  the  Deputy  Chief  of  Naval  Operations  (Matnpower,  Personnel,  and 
Training,  OP-01).  subproject  was  directed  toward  resolving  fundamental  human 

engineering  design  issues  in  systems  that  contain  mam/computer  interfaces.  Preliminary 
research  for  this  subproject  was  performed  under  subproject  ZF55-52 1-00 1-022,  work  unit 
03.03  (forecasting  new  task  requirements). 

This  report  provides  a  selected  annotated  bibliography  of  technical  literature 
relevant  to  human/computer  transaction  tasks.  Operator-analyst  and  software  program¬ 
mer  roles  are  represented  by  the  majority  of  references.  The  literature  review  was 
completed  in  June  1978  and  results  were  used  at  the  Navy  Personnel  Reseaurch  and 
Development  Center  in  research  to  resolve  fundamental  human  engineering  design  issues 
for  computer  systems.  The  mathematical  techniques  used  in  this  subproject  to  project 
operator  performance  can  be  used  for  other  forecasting  problems. 

The  bibliography  is  being  published  at  this  time  to  make  it  available  to  the  research 
community  and  to  others  developing  systems  requiring  man/computer  interfaces. 

The  contracting  officer's  technical  representative  was  Dr.  P.  A.  Muckier. 


JAMES  F.  KELLY,  JR. 
Commanding  Officer 


JAMES  J.  REGAN 
Technical  Director 
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INTRODUCTION 


Problem 


The  area  of  human/computer  interaction  constitutes  a  sigi^icant  portion  of  present 
research  in  human  factors  engineering.  While  many  questions  still  require  investigation,  a 
large  amount  of  work  has  appeared  in  the  literature  to  date. 

Purpose 

The  purpose  of  this  effort  was  to  provide  a  bibliography  for  use  by  those  developing 
systems  containing  man/computer  interfaces. 

Approach 

An  extensive  computerized  iibrary  literature  search  of  the  National  Technical 
Information  Service  and  Psychological  Abstracts  files  was  conducted.  Only  references 
that  are  readily  available,  either  in  reprint  form  or  from  the  author,  were  included  in  the 
bibliography. 

Results 


The  resulting  annotated  bibliography  is  provided  in  the  appendix.  It  includes  selected 
references  from  numerous  technical  reports,  journal  articles,  and  texts  relating  to 
human/computer  transactions.  Operator-analyst  and  software  programmer  rotes  are 
represented  by  the  majority  of  the  references  included.  Computer-assisted  instruction, 
computer -managed  instruction,  and  the  rote  of  the  computer  in  training  are  not  covered  in 
this  bibliography.  The  references  included  are  concerned  primarily  with  display  format¬ 
ting,  error  modeling,  performance  assessment,  query  languages,  keyboard  and  data  entry, 
data  organization,  and  speech  input/output. 

Abstracts  written  by  the  author  of  each  reference  were  used  where  possible.  In 
instances  where  no  formal  abstract  was  available,  a  brief  summary  written  by  the 
compiler  of  this  bibliography  is  provided. 
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APPENDIX 

BIBLIOGRAPHY 


A-0 


Abraas,  H.  D. «  Lindaaood,  6.B.»  and  Pyke,  T.  M.,  Jr.  NAasaring 
and  Bodellnq  aan-coapnter  interaction.  Proceedings  Annual 
SISILE  SyaPQSioa  fin  Heasoreaent  and  Paaluation  {1st)  ,  Palo 
Alto,  California,  February  26-28,  1971,  136-142. 


The  Dialogue  Monitor  has  been  dere loped  as  a  tool  for  the 
neasureaent  of  coaputer  service,  Tne  obiectives  of  such 
aeasureaents  are  defined.  A  set  of  aodels  and  aeasures  are 
developed.  Operation  of  the  Dialogue  Monitor  and  analysis  of 
the  data  obtained  are  briefly  discussed. 


Alden,  D.  G.,  Daniels,  P.  P.,  and  Manarick,  a.  P.  keyboard  design 
and  operation:  A  review  of  the  aajor  issues.  Huaan  Factors. 
1972,  14,  275-293. 


A  search  of  the  psychological,  technical,  and  proaotional 
literature  was  conducted  to  coapile  inforaation  relevant  to 
key,  keyboard,  and  operator  characteristics.  The  aost  recent 
and  signlfican'^  articles  were  discussed  and  evaluated,  where 
possible,  general  conclusions  have  been  drawn  to  aid  the 
keyboard  designer* 


Alford,  E.  C.  and  Buck,  j.  R.  A  unit  task  siaulator  for  off-line 
evaluation  of  aan/coaputer  interfaces.  Proceedings  pf  t||fi 
International  Brgonoaics  Association.  6th  Annual  Meeting, 
Santa  Monica  California:  Huaan  Factors  Society,  1976. 


A  aethod  is  shown  for  siaula^'ing  individual  operator 
aan/coaputer  tasks  and  collecting  perforaance  statistics. 
This  aethod  employs  a  ainicoaputer  with  structured  software 
that  receives  user-written  prograas  for  the  specific 
processes  and  for  display  formatting.  Dsers  can  easily  try 
out  and  evaluate  alternaive  interface  designs,  different 
coabinations  of  task  assignaents,  or  various  foraattino 
dialogues.  job  and  task  perforaance  characteristics  are 
directly  obtained.  An  illustration  is  given.  These 
performance  characteristics  nay  be  used  comparatively  or  as 
inputs  to  a  total  system  simulation  for  the  design  of  large 
aan/aachine  systeas. 


A-1 


Alloisi,  E.  A.  H<»thoaology  in  the  nre  of  synthetic  tasks  to 
assess  coaplex  perforiance.  Hunan  Factors,  1967,  9,  376-384. 


The  application  of  synthetic  tasks  to  the  assessment  of 
complex  performance  is  discussed  in  relation  to  the  trade¬ 
offs  involved  in  achieving  adequate  levels  of  face  validity 
and  in  specifying  the  exact  chances  in  psychological 
functions  that  nay  result  from  particular  environmental 
nanipnlations.  It  is  argued  that  the  multiple-task 
performance  battery  approach  can  provide  levels  of  face 
validity  adeguate  to  maintain  the  motivation  of  subjects 
while  at  the  sane  tine  permitting  the  identification  of 
charges  in  specific  performance  functions.  the 

characteristics  of  this  approach  are  discussed  in  relation  to 
a  procran  of  research  on  the  effects  of  confinement  and 
demanding  workrest  schedules  on  crew  performance. 


Anbrozy,  D.  on  man-computer  dialogue.  International  JouEnal  of 
Han-Machine  Studies.  1971,  3  (4),  375-383. 


Bv^ry  man-computer  interaction  involves  some  kind  of 
dialogue;  however  it  is  not  yet  fully  clear  what  kind  of 
activity  can  be  called  a  dialogue  and  how  to  calculate  its 
simpler  parameters.  This  paper  surveys  some  aspects  of  ♦he 
seemingly  simple  problem  and  presents  a  formulation  of  the 
dialogue  and  of  the  basic  human  factor  influencing  its 
course;  the  specific  fatigue  associated  with  the  information 
processing  work  of  the  human  nervous  system. 


Atwood,  F.  and  Rawsey,  ff.  B.  Cognitive  stractaros  in  the 

cowprehension  and  aewory  of  cowpnter  prograws;  Hr 
inwestigation  of  cowpoter  prograw  conprehension  debugging. 
Englewood,  Colorado:  Science  Applications,  Incorporated, 
Eei^tt  Mo.  SAI-77-194-0EM,  October,  1974. 


A  theoretical  frawework,  based  upon  recent  studies  in 
cognitive  psychology  on  newory  for  text,  was  developed  to 
explain  certain  aspects  of  huaan  behavior  during  cowpnter 
program  conprehension  and  debugging.  A  central  concept  of 
this  framework  is  that  the  information  contained  in  a  program 
is  represented  in  a  programmer's  memory  as  a  connected, 
partially  ordered  list  (hierarchy)  of  "propositions*  (units 
of  information  with  properties  similar  to  those  observed  in 
research  on  text  neBory) .  An  experiment  was  performed  to 
test  the  hypothesis  that  the  difficulty  in  finding  a  program 
bug  is  a  function  of  the  bug's  location  in  this  hierarchy. 
This  experiment,  which  was  based  on  a  paradigm  previously 
used  by  others,  compared  the  effects  of  bug  location,  bug 
type  (array,  iteration,  assignment)  and  specific  program. 
Subjects  were  48  undergraduate  students  with  a  minimum 
experience  level  of  three  computer  science  courses.  Each 
subject  debugged  two  separate  programs,  with  one  type  of  bug 
at  two  different  hierarchical  levels  in  each  program.  A 
preliminary  analysis  suggested  that  all  three  factors  — 
program,  bug  type,  and  bug  location  —  signif icar tly 
affected  the  tine  required  to  locate  program  bugs.  Detailed 
analyses,  however,  suggested  the  program  and  bug  type 
variables  could  be  explained  in  terns  of  the  bug  location 
variable  and  that  a  bug's  location  in  a  proram's  underlying 
propositional  hierarchy  Is  a  principal  factor  affecting 
performance  in  a  conprehension  and  debugging  task.  The 
difficulty  in  detecting  a  bug  is  a  function  of  the  bug's 
location  in  the  propositional  hierarchy  that  a  programmer 
constructs  to  represent  a  program.  Programs  should  be 
written  so  as  to  avoid  unnecessarily  deep  hierarchies  and 
modularized  so  as  to  minimize  the  number  of  propositions  in  a 
given  section  in  order  to  facilitate  computer  program 
conprehension  and  debugging.  The  principal  contribution  of 
this  research  is  the  demonstration  of  an  initial  theoretical 
framework  which,  with  further  development,  nay  assist 
considerably  in  the  integration  of  research  findings  and  the 
guidance  of  future  research  on  the  psychological  aspects  of 
software  development. 


Baker «  J.  n.  Proqraaaed  instraction  as  a  aethcdoloqlcal  tool  ir. 

psychological  research.  Jonrnal  of  Proora aaed  Instruction. 
1963,  2  Cl),  20-23. 


The  use  of  prograaaed  instruction  as  a  aethodological  ♦•ool  in 
psychological  research  is  presented  as  a  aeans  for  incr^asinq 
ezperiaental  control.  one  advantage  in  using  prograaaed 
instraction  in  the  orientation  and  training  phase  of 
psychological  studies  is  that  it  insures  controlled 
presentation  of  coaplez  instructions  for  novel  ezperiaental 
tasks  which  use  unique  naterials.  I  second  advantage  is  that 
it  reduces  to  a  ainiaua  the  personal  interaction  between 
ezperiaenter  and  suh-}ect,  which  could  introduce  bias  into  the 
ezperiaent.  It  is  suggested  that  an  inventory  of  prograas 
for  counoc  ezperimental  tasks  would  provide  a  basis  for 
better  intrastudy  generalization  in  ezperiaental  psychology. 


Baker,  J.  D.  Quantitative  aodeling  of  hnaar  petforaanc®  in 
inforaation  systeas.  groonoaics.  1970,  13,  6U5-664. 


This  paper  suaaarizes  an  approach  toward  developing  a  general 
inforaatin  system  model  which  focuses  on  lan  and  considers 
the  computer  only  as  a  tool.  The  ul'*-imate  objective  is  to 
produce  a  simulator  which  will  yield  measures  of  system 
performance  under  different  mizes  of  equipment,  personnel  and 
procedures.  In  structuring  the  framework  for  this  model  the 
assumption  was  made  that  men  hawe  five  basic  and  critical 
operations  to  perform  in  an  information  system:  screen, 
transform,  input,  assimilate  and  decide.  These  operations, 
or  functional  areas,  are  interrelated  along  three  dimensions: 
(1)  a  data  flow  and  processing  dimension:  (2)  a  task 
analysis  dimension  for  each  event  in  the  data  flow  sequence; 
and  (3)  a  source  of  variation  dimension,  such  as  level  of 
training.  The  model  approach  described  has  several  major 
poi  .s  of  payoff.  Among  the  immediate  benefit  is  th® 
potential  for  using  the  model  to  quantify  human  performance 
by  employing  system  measures  and  the  value  of  the  model  as  a 
tested,  usable  tool  for  deweloping  test  and  evaluation  plans 
which  will  provide  human  factors  data  as  part  of  the 
informtion  system  design  verification  checkout. 


Baker,  J.  D.  How  will  imoroveuents  in  uan-machine  interface 

affect  learning?  In  R.  J,  Seidel  and  H.  L.  Rubin  (Ids.) 
Computeps  and  communication:  Implications  for  education. 
Pew  York:  Academic  Press,  I*??,  ” 


This  paper  defines  inforaation  systeas  and  makes  suggestions 
concerning  coaputers-in-edocation  problems,  display  problems, 
and  man-computer  interaction  and  information  transfer. 
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Baker*  J.  Q.*  Race*  n.  J.*  and  HcKendry*  J.  H.  The  transform 

operation  in  TOS:  kssessaent  of  the  haaan  coaponen^. 
Arlington,  Virginia:  O.S,  kray  Behavioral  Science  Research 
Laboratory,  Technical  Research  Rote  212,  Angost,  1969. 


Forty-seven  siaple  aessages  were  given  to  14  individuals 
faailiar  with  TOS  er  G3  operations,  or  both.  Their  task  was 
to  select  an  appropriate  foraat  for  each  aessage.  Balf  the 
aen  used  a  siaple  job  aid  devised  by  the  experiaenters;  the 
ether  half  used  a  '‘aenu"  type  listing  of  available  foraats. 
The  tine  taken  to  coaplete  the  entire  task  was  recorded. 
Individuals  also  rated  the  degree  of  confidence  they  had  that 
the  proper  format  had  been  selected.  Average  error  rate  in 
foraat  selection  was  22t.  Hean  tine  to  read  the  aessage  and 
select  a  format  was  approxiaately  SO  seconds.  Perforaarce 
with  the  job  aid  was  neither  better  nor  worse  than  with  the 
aenu  type  listing.  Hessages  of  different  types  and  subject 
aatter  differed  in  error  rate  of  foraat  selection.  The  study 
provided  baseline  data  with  which  future  perforaance  can  be 
compared.  The  findings  suggested  some  approaches  to  training 
and  alternative  methods  for  the  transform  process. 


Barmack,  J.  R.  and  Sinaiko,  H.  R.  Hunan  factors  problems  in 

coaputer-generated  graphic  displays.  Arlington,  Virginia: 
Institute  for  Defense  Analyses,  Report  Ro.  S-234,  April, 
1966. 


This  paper  reports  a  review  of  the  state  of  the  art  with 
respect  to  human  factors  as  applied  to  interactive  graphical 
computer  systems.  Information  in  the  report  was  derived  from 
both  a  review  of  the  literature  and  visits  to  14  facilities 
employing  such  systems.  The  review  is  broad  in  scope, 
including  discussions  of:  CRT  display  parameters,  display 
coding,  display  flicker,  three-dimensional  displays,  and 
syabols,  input  devices,  including  keyboards,  character  and 
speech  recognition,  light  pens,  and  switches;  general  system 
properties;  and  a  theoretical  discussion  of  the  use  of 
computers  to  enhance  creative  effort. 
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Bac»-ett,  G,  ,  Thornton,  C.  1.,  and  Cabe,  P,  R.  Huaan  factors 

«valtta+ion  of  a  coaputar-based  Jrforaation  storaqe  and 
retrieval  systea.  Hoaan  Factors.  1968,  JO,  431-436, 


the  hoaan  factors  aspects  of  a  coapoter-based  inforaatior 
storage  and  retrieval  systea  were  evaluated  in  three 
qovernaent  intelligence  services  using  questionnaire  and 
interview  technigues.  It  was  found  that  many  factors  entered 
into  satisfaction  with  the  information  system,  including 
familiarity,  ease  of  use,  and  importance.  Other  relevant- 
factors  included  training  in  the  use  of  the  system,  amount 
and  type  of  Inforaation  to  meet  need  in  the  system,  and 
t-olerarces  of  individuals  for  irrelevant  material  in  the 
output  of  searches.  The  interaction  of  these  factors  is 
discussed  in  relation  to  satisfaction  with  the  systea. 


Bergaan,  C.  a.  An  airplane  performance  control  systea:  A  flight 
experiment.  Human  Factors,  1976,  J8,  173-182. 


Pilots  perforaance  and  preference  measures  were  obtained  for 
12  pilots  in  actual  flight  operations  using  a  twin-engine 
general  aircraft  with  both  conventional  controls  and  a 
Perforaance  Control  System  (PCS),  The  PCS  provides  zero- 
order  control  of  aircraft  bank  angle  and  vertical  speed  over 
the  ranges  of  ±60®  and  ±457,2  a/ain,  respectively.  An 
inforaation  processing  side-task  was  also  used,  ii^h  the 
PCS,  flight  error  scores  were  reliably  lower  than  with 
conventional  aircraft  controls.  Pilot  preferences,  usrg  a 
six-point  scale,  ranging  froa  "slight"  to  "moderate"  to 
"strong"  preference  for  each  of  the  two  control  systems, 
showed  a  "moderate  preference  for  the  PCS"  as  the  median 
response. 


B^rson,  B.  I..,  Crooks,  v.  R.,  shaket,  B. ,  ard  Vf^ltaan,  G. 

Han-aachine  coaaunication  in  coaputer-aided  r^aot® 
aani palation .  Roodland  Hills,  California:  Perceptronics, 
Technical  Report  PATR-1034-77-3/1,  Hatch,  1977, 


Autoaated  React©  Manipulation  is  both  an  area  of  qreat 
practical  utili+’V  for  HaTy  Undersea  Operations,  and  a  prim© 
example  of  new  of  aan-aachinc  interaction  in  which  the 
huaan  operator  aust  supervise  and  control  a  complex  and 
adaptive  man-coaputer  system.  This  report  presents  the 
results  of  an  experimental  study  focusing  on  man-machine 
coaaunication  with  computer-aided  manipulators.  This  report 
describes  <1)  underwater  manipulator  functions  and  operator 
performance  requirements  in  remote  manipulation,  (2)  the 
development  of  theoretical  aan-aachire  communication  model 
based  on  procedural  se*-s,  and  (3)  an  experimental 
investigation  on  the  effect  of  several  elementary  computer 
aiding  techniques  on  the  ability  of  training  operators  to 
perform  selected  remote  manipulation  tasks.  The  results  of 
the  experimental  investigation  indicated  that  computer  aiding 
can  significantly  decrease  task  performance  times  for  a 
number  of  remote  manipulation  tasks.  computer  aiding  in  the 
form  of  resolved  notion  and  automated  control  significantly 
reduced  the  tines  required  to  perform  valve  turning  and  ring 
manipulation  tasks.  The  results  also  indicated  that  if 
higher-level  aiding  schemes  are  to  be  effective  in  terns  of 
improving  nan-machine  performance,  the  design  of  the 
communications  language  and  interface  must  be  car«»fully 
designed  to  maintain  the  communication  goals  of  naturalness, 
simplicity  and  understandability. 


Blanchard,  B.  R.  Hunan  perfornancc  and  personnel  resources  data 
store  desiqn  guidelines.  Hunan  Factors.  1975,  17,  25-34. 


A  survey  was  conducted  within  the  navy's  research  and 
developnen'’  coamnnity  to  obtain  inforaation  on  user-perceived 
needs  for  huaan  performance  and  personnel  resource  data  to 
support  system  development  efforts.  Findings  were  to  be  used 
to  develop  guidelines  for  planning  and  developing  a  human 
resources  data  store  system.  Twenty-two  activities  wer^ 
contacted;  eighteen  Mavy  activities  and  four  industrial 
firms.  Thirty-seven  separate  interview  sessions  were  held 
involving  48  respondents.  Principal  data  store  guidelines 
identified  concerned  data  validity  and  generalizabili'-y , 
retrievability,  a  priority  need  for  design  trade-off  decision 
data,  and  a  data  format  responsive  to  users  with  either 
behavioral  or  engineering  backgrounds.  Sixteen  tvoes  of  data 
were  identified  as  required  by  system  planners/managers, 
huaan  factors  specialists,  and  desion  engineers.  Twenty 
guidelines  were  developed  on  data  presentation  formats  and 
supporting  information.  The  sets  of  guidelines  nay  be  used 
to  develop  a  conceptual  framework  for  a  general  data  bank 
system  which  would  identify  and  relate  users,  types  of  data, 
potential  data  sources,  and  program  priorities. 


Boies,  S.  J.  and  Gould,  J.  D.  Syntactic  errors  in  computer 
programming.  Human  Factors.  1974,  16,  253-257. 


A  study  of  users  of  a  large-scale  computer  system  (T5S/360) 
revealed  that  only  12  to  1755  cf  the  FORTBAH,  PL1 ,  and 
Assembler  Language  computer  programs  submitted  to  the 
language  processors  contained  syntactic  errors.  Thus, 
syntactic  errors  do  not  aopear  to  be  a  significant  bottleneck 
In  programming.  This  experiment  is  part  of  a  larger  effort 
to  identify  and  reduce  the  behavioral  bottlenecks  in  computer 
programming. 


Bovs«r«  S.  F.  Deter«inatioD  of  criteria  of  operational  anit 

effectiveness  in  the  O.S,  Havy,  San  Diego,  California:  Navy 
Personnel  Research  and  Developnent  center.  Report  No.  NPRDC 
TR  76T0-41,  August,  1476. 


The  criteria  for  evaluating  organizational  effectiveness  are 
considared  within  a  systee  fraeevoric.  A  general  review  of 
the  literature  is  presented.  Operational  unit  uanagenent 
personnel  were  interviewed  and  this  interview  naterial  was 
content  analyzed.  The  resulting  content  categories  were 
cross  coepared  by  unit  type,  position  in  the  organization, 
tank  of  respondent  and  question  answered.  The  results  show 
tilitary  aanagers  to  be  perforuance  oriented  and  supportive 
of  objective  type  criteria  for  evaluations. 


Brown,  G.  P.  A  fraaework  for  processing  dialogue.  Caebridgo, 

flassachusetts;  Nasachusetts  Institute  of  Technology, 
Canbridge  Lab  for  Coepnter  Science,  Report  No. 
niT/LCS/TR-182,  June,  1977. 


This  report  describes  a  frauework  for  handling  nixed- 
initiative  English  dialogue  in  a  console  session  environnent, 
with  enphasis  on  recognition,  lithin  this  framework,  both 
linguistic  and  nonlinguistic  activities  are  nodelled  by 
structures  called  *wethods»,  which  are  a  declaratiwe  for*  of 
procedural  knowledge.  The  design  focuses  on  units  of 
linguistic  activity  larger  than  the  speech  act,  so  that  the 
pragiatic  and  semantic  context  of  an  utterance  can  be  used  to 
guide  its  interpretation.  Also  important  is  the  treatment  of 
indirect  speech  acts,  e.g, ,  the  different  ways  to  ask  a 
question,  give  a  command,  etc.  Given  the  static  model  of 
dialogue  embodied  in  the  methods,  the  problem  is  to  find  the 
correct  method  step  that  relates  to  a  particular  input.  This 
problem  is  handled  through  a  combination  of  careful 
structural  distinctions  and  the  use  of  multiple  recognition 
strategies.  The  dialogue  methods  are  used  to  generate 
expectations  dynamically,  special  structures  are  used  to 
facilitate  matching,  and  a  basic  distinction  between  four 
sajer  utterance  classes  is  used  to  determine  which  of  several 
overall  matching  strategies  should  be  used  for  a  given 
ezpectationn. 


rown,  R.  H.  An  experimental  study  of  an  on-lire  lan-computer 

sys^-rm.  JEJE  Transactions  on  Electronic  Computers.  February, 
196*^,  EC;14,  02-85. 


One  of  the  more  promising  areas  of  computer  use  involves  the 
coupling  of  a  man  to  a  computer  system  for  real-time  problem 
solving  where  the  procedure  for  solution  of  the  problem  is 
either  unknown  or  involves  complex  tasks,  such  as  pattern 
recognition,  that  can  best  be  performed  by  humans  (1) . 
Unfortunately,  a  straightforward  approach  to  such  use  commits 
significant  amounts  of  computer  time  most  of  which  is  spent 
idling.  The  imbalance  in  operating  costs,  assignable  to 
human  and  the  computer,  argues  against  computer  use  unless 
th°  total  gain  over  strictly  manual  operations  is 
suff ici'rntly  great.  The  technique  of  computer  time-sharing, 
currently  under  deweiopmer*  in  several  institutions  (2), 
attempts  to  divide  the  computer  costs  among  a  number  of  users 
by  interleaving  the  execution  of  their  programs  so  as  to 
share  the  operations  time  while  also  minimizing  mutual 
conflicts.  The  success  of  this  technique  rests  on  a  number 
of  assumptions  concerninq  the  characteristics  of  the  programs 
if  run  alone.  This  paper  defines  some  properties  of  on-line 
programs  useful  in  predicting  their  performance  under  time¬ 
sharing.  It  then  describes  a  specific  man-machine  prooram 
and  gives  experimental  measurements  on  this  program.  While 
at  this  stage  of  understanding,  no  man-machine  program  can  be 
described  as  "typical,"  this  program,  containing  both 
operator-controlled  data  measurement  and  typewriter  dialogue 
between  a  coipu+:er  program  and  an  operator,  is  sufficiently 
illustrative  of  interactions  that  can  occur  so  that  the  data 
cn  such  a  program  are  felt  to  be  of  help  to  system  planners. 
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Caplui),  S.  H.  Gaidelicfrs  for  cedacina  kaaan  arrors  in  tha  use  of 
coded  inforaation.  Proceed in as  of  the  Ho aan  Factors  SocletY. 
19th  Annual  fleet ing,  Dallas,  Texas,  1975. 


This  paper  presents  code  design  and  display  goidallnes 
intended  to  oahe  it.  difficult  to  generate  a  code-related 
error  and  easy  to  detect  errors  that  still  occur.  Principles 
governing  isaediate  aeaory  and  rules  for  asking  erroneous 
codes  easily  recognizable  coabine  to  fora  guidelines  for  code 
design.  Design  factors  include  various  diaensions  of  code 
configuration  length,  the  kind  of  characters,  their  location 
and  grouping.  These  guidelines  ainiaize  the  coaaon  errors  of 
substitution,  transposition,  cepission,  and  addition  of 
characters.  Besides  the  code  itself,  errors  are  also 
affected  by  the  way  the  code  is  displayed.  To  further 
enhance  reliability,  additional  guidelines  are  included  for 
the  size,  style,  and  contrast  of  characters.  A  reliable  code 
systea  requires  a  structure  which  is  coapatible  with  huaar 
recognition  and  short-tern  aeaory  capabilities.  These 
abilities  have  been  extensively  explored  in  the  experiaental 
psychology  literature.  The  particular  studies  used  as  a 
basis  for  the  code  guidelines  in  this  paper  are  those  where 
recall  follows  perception  by  only  a  few  seconds  and  no 
intervening  inforaation  is  processed  in  the  interin.  These 
experiaental  conditions  correspond  to  usual  transactions  in 
which  transcription  or  keypunching  closely  follows  visual 
perception  of  the  code. 
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Carbon«ll,  R.  On  Bar-coapater  interaction:  A  aodel  and  soae 

related  i senes.  TFBP  Transactions  on  STSteas  SciSftSS.  iHl 
Cybernetics  SSC-5  (1) ,  16-26. 


A  snryey  of  the  literature  related  to  aar-coaput^r 
in^-eraction  reveals  the  aany  aspects  of  this  problea,  which 
appears  to  be  ir  the  crossroads  aaong  snch  diverse  fields  as 
coapnter  languages,  coaputer  systeas  operational 
characteristics,  control  theory,  decision  theory,  inforaatior 
theory,  applied  psychology,  coaputer  display  and  interface 
engineering,  etc.  In  this  paper  we  have  chosen  to  present 
the  on-line  interaction  froa  an  inforaation  and  decision 
point  of  view.  After  a  brief  discussion  of  classes  of  on¬ 
line  situations  and  tasks,  we  propose  an  inforaation- 
processing  aodel  of  the  case  in  which  a  huaan  operator  is 
engaged  on-line  in  the  solution  of  a  problea  like  debugging  a 
prograa,  testing  a  aodel  in  a  scientific  application,  or 
perforaing  a  library  search.  In  this  aodel  the  hnaan 
operator  is  considered  to  seek  to  aariaize  overall  cost . 
This  cos-*-  is  obtained  by  adding  the  operational  cost  of  both 
nan  and  coaputer  to  a  reanant  Seminal  cost  originated  by  the 
reaaining  uncertainty.  This  analysis,  perforaed  for  each  of 
a  set  of  possible  alternatives  for  action,  aay  lead  the  man 
to  select  and  execute  one  of  thea,  to  terminate  the  process, 
or  to  reevaluat®  the  possible  alternatives  and/or  hypotheses 
in  a  search  for  new  ones.  Some  practical  applications  in 
terns  of  response  time  and  other  characteristics  of  a 
computer  utility  are  discussed,  as  well  as  soae  theoretical 
iaplica+ions  froa  an  inforaational  point  of  view. 
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Carborell,  J.  R.,  Rlkina,  J.  I.,  and  Dickerson,  R.  S.  On  th*? 

psychological  iapor'^anca  of  tise  in  a  tiae  sharing  syst*n. 
SlfSll  Fgctoys.  1968,  JO,  135-192, 


One  of  the  aost  isportant  probless  in  the  design  and/cr 
operation  of  a  coaputer  utili+y  is  to  obtain  dynaaical 
characteristics  that  are  acceptable  and  convenient  to  the  on¬ 
line  nser.  This  paper  is  concerned  with  the  probless  of 
access  to  the  coaputer  utility,  response  tiae  and  its  effect 
upon  conversational  use  of  the  coaputer,  and  the  effects  of 
load  on  the  systea.  Priaary  attention  is  placed  upon 
response  tiae;  rather  than  a  single  aeasure,  a  se'*’  of 
response  times  should  be  aeasured  in  a  given  coaputer 
utility,  in  correspondence  to  ♦he  different  types  of 
operations  reguested.  It  is  assumed  that  the  psychological 
value  of  short  response  tine  stems  from  a  sub-jective  cost 
aeasure  of  the  user*s  own  tiae,  laroely  influenced  by  the 
value  of  concurrent  tasks  being  postponed.  \  aeasure  of  cost 
(to  the  individual  and/or  his  organization)  of  the  tiae-on- 
line  reguired  to  perform  a  task  aight  thus  be  derived.  More 
subtle  is  the  problem  of  the  user's  acceptability  of  given 
response  tines.  This  acceptability  is  a  function  of  the 
service  requested  (e.g.,  length  of  conputation) ,  and 
variability  with  respect  to  expectations  due  both  to 
uncertainty  in  ♦he  user's  estimation  and  to  variations  in  the 
response  tiae  originated  by  variable  loads  on  the  system.  An 
effort  should  be  aade  by  coaputer-ntility  designers  to 
include  dynamic  characteristics  (such  as  prediction  of  loads 
and  their  effects)  among  their  design  specifications. 
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Chapanis,  A.  I,  In+'Practive  huaan  coaaanicatlon.  Scientif j.c 
#pgTicap. .  Narch,  1975,  36-42. 


A  spries  of  pitppriaents  is  described  in  which  two  members  of 
a  problea-solwinq  tea*  are  each  given  partial  problem 
information.  Ore  of  them,  the  "seeker**,  is  assigned  a 
particular  task  ♦o  perform,  for  which  he  requires  information 
possessed  by  the  other,  the  **sonrce**.  The  roles  of  these 
sublects  are  intended  to  correspond  loosely  to  those  of 
computer  system  user  and  computer  system,  respectively.  The 
sublects  are  allowed  to  communicate  through  various  media 
(voice,  video,  handwriting,  typewritting,  and  various 
combinations) ,  and  the  effects,  both  on  problem-solvina 
effectiveness  and  on  the  nature  of  the  conversation,  are 
cbservod.  Conversations,  while  effective,  were  found  to  he 
extremely  ungrammatical  by  formal  english  grammar  standards. 
The  presence  or  absence  of  voice  communication  as  one  of  the 
allowed  media  was  the  most  important  experimental  variable. 
Experimental  conditions  involving  voice  communication  had 
more  and  shorter  messages,  more  total  words  exchanged, 
greater  message  redundancy,  greater  communication  ra^es  and 
faster  problem  solution  than  other  conditions. 


Chu,  y.  and  Rouse,  w,  B,  Opcimal  adaptive  allocation  of  decision 
making  responsibility  between  human  and  computer  in  mul*-i- 
task  situations.  Paper  presented  at  the  International 
Conference  on  cybernetics  and  Society,  Washington,  D.  C., 
September  19-21,  1977. 


It  is  suggested  that  the  computer  serve  as  a  backup  decision 
maker  in  nulti-*-ask  situations,  accepting  responsibility  when 
workload  becomes  excessive  and  relinquishing  responsibility 
when  workload  becomes  acceptable.  A  queueing  theory 
formulation  of  mul^i-task  decision  making  is  used  to  develop 
a  procedure  for  determining  when  the  computer  should  be 
assigned  decision  making  responsibility  The  procedure  is 
illustrared  by  application  to  a  computer-aided  flight 
management  situation. 


Clapp,  L.  C.  Nan-compater  interaction  and  context  progranainq. 

Rewton,  Nassachnsetts:  coapnter  Research  Corporation,  Report 
Ro.  P102-6,  July,  1970. 


The  report  is  concerned  with  the  coanunication  between  nan 
and  the  conputer  systens  he  uses  for  problea  solting  and 
nanageaent  planning.  To  bridge  the  gao  between  problea 
solving  needs  and  the  ability  of  problea  solvers  to  write- 
their  own  prograns,  the  trend  has  been  to  create  pre-packaged 
proaraas  which  can  solve  a  class  of  probleas  once  the 
pertinent  data  has  been  supplied.  One  iapedinent  toward  the 
developnent  of  better  problea  solving  tools  which  will 
operate  in  conjunction  with  on-tine  conputer  systeas  is  a 
nethodology  for  structuring  the  dialogue  between  the  problea 
solver  and  his  aachine.  k  series  of  generalized  dialogue 
handling  routines  was  progranned  for  a  tine-sharing  system 
operating  on  a  Scientific  Data  Systeas  conputer  (SOS-990)  . 
The  general  set  of  routines  is  called  the  conaand  Package. 
The  Conaand  Package  is  then  used  in  several  different 
applications  areas  drawn  fron  nathenatics,  engineering  and 
general  nodeling  and  siaulation. 


Coffey,  J.  L.  I  coaparison  of  vertical  and  horizontal 

arrangeaents  of  alpha-nuaeric  aaterlal-experiaent  1.  Hopa^i 
Fgigtq|;s.  1961,  5,  93-98. 


The  objective  of  this  study  was  to  deternine  the  relative 
effectiveness  of  visual  displays  containing  alpha-numeric 
naterial  displayed  in  vertical  and  horizontal  arrangements, 
variables  included  in  the  experimental  design  were?  types  of 
arrangement  of  display  material,  density  of  material, 
composition  of  naterial,  and  operator  tasks.  The  aaior 
finding  in  the  study  was  the  non-significance  of  the 
arranqenent  variable.  It  was  found  that,  for  all  practical 
purposes,  the  differential  effects  of  vertical  and  horizontal 
arrangenent  of  alpha-nuaeric  materials  on  operator 
performance  are  negligible. 


Collins,  A.  n.  and  Qnillian,  R.  P.  How  to  wake  a  language  user. 

In  E.  Tulwing  and  ®.  Donaldson  (Eds.)  organization  of 
Reaory.  New  York;  Acadeaic  Press,  1972,  310-349, 


This  paper  discusses  how  sowe  of  the  aaior  pieces  of  a 
language  user  fit  together.  The  frawework  provided  describes 
the  hunan  language  user  as  viewed  fros  the  perspective  of  a 
oowputer.  Two  wajor  sections  are  included  in  the  paper,  cn® 
about  the  structure  of  seaantic  sesory  and  one  about 
processing  on  that  structure.  For  the  structure,  the  nature 
of  concepts  and  their  relation  to  words  and  iwages,  the  kind 
of  sesantic  inforaation  people  learn  and  do  not  learn,  and 
the  kinds  of  inference-bearing  relations  that  fora  the  basis 
for  the  organization  of  seaantic  aeaory  are  discussed.  With 
regard  to  processing,  the  seaantic  search  during 
comprehension  and  retrieval,  the  tacit  processing  which  this 
search  implies,  the  pervasiveness  of  identifying  similar 
concepts  with  each  other  in  language  processing,  the  decision 
rules  that  are  applied  to  the  results  of  a  semantic  search  in 
order  to  decide  whether  two  similar  concepts  can  be 
identified,  the  role  imagery  plays  in  language  processing, 
and  the  way  people  induce  what  properties  to  store  with  what 
concepts  are  discussed. 


Cornog,  D.  y.  Human  factors  engineering  in  the  postal  service, 

Rockville,  Hatylard:  O.S,  Postal  Service,  Research  and 

Development  Department,  Report  No.  5HPD02-2,  December,  197f, 


The  work  done  in  solving  human  factors  problems  in  postal 
operations  and  in  the  development  of  postal  systems  and 
equipment  is  presented  in  a  chronologically  arranged, 
annotated  bibliography  of  Postal  service  Human  Factors 
Program  reports,  documents  and  related  publications. 


Cornog,  J.  P,  and  Craig,  j,  c.  Keyboards  and  coding  systems  urd»r 
consideration  for  use  in  the  sorting  of  O.S.  mail.  Paper 
presented  at  the  Sixth  Annual  Symposium  of  the  Professional 
Group  on  Human  Factors  in  Electronics,  the  Institute  of 
Electrical  and  Electronic  Engineers,  Boston,  Hassachusetts, 
Hay  6,  1965. 


In  addition  to  a  general  discussion  of  Post  of fie*  human 
factors  problems,  specific  comments  cover  the  memorized 
numerical  codes,  the  extraction  codes  (S-4,  S-1  modified,  and 
PAT),  tho  unmemorized  numerical  codes  (ZIP)  and  ♦he  several 
keyboards  (Burroughs,  Levy,  FHC,  and  the  Sark  Sor^-^r 
keyboards)  . 
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Crawford,  A.  d.  Interactive  coapnter  graphics  for  sirnlation 

displays.  Proceedings  gf  the  Haean  Factors  Society.  21st 
Annnal  Heeting,  Sar  Francisco,  California,  1977.  ” 


Interactive  coapoter  graphics  were  discussed  within  ^he 
context  of  recent  research  trends  which  represents  a 
consolidation  of  sinulation  and  learning  technologies. 
Besearch  that  has  utilixed  graphics  for  training  was 
described  and  discussed  in  an  atteapt  to  assess  the 
usefulness  of  the  technology  across  a  wide  variety  of 
applications. 


Crooks,  H.  H. ,  Artof,  H.,  Beltaan,  G.,  and  Freedy,  A.  Han/aachine 
interaction  in  adaptive  coaputer  aided  control:  Analysis  of 
autoaated  control  allocation.  Voodland  Hills,  California, 
Perceptronics,  Report  Mo.  PATB-1008-74- 12/30,  Deceaber,  1974. 


Control  allocation  between  the  huaan  operator  and  an 
intelligent  control  eleaent  is  becoairg  an  iaportant  part  of 
advanced  Navy  systeas,  which  place  increasing  eaphasis  on 
decision  aaking  as  coapared  with  aanual  control.  The  present 
research  focuses  on  huaan  factors  criteria  for  the 
aan/aachine  interactions  in  such  shared  decision  and  control 
systeas.  The  research  effort  includes  evaluations  of  task 
allocation  aethods,  inforaation  feedback,  decision  risks,  and 
operator  indoctrination.  This  report  presents  the  results  of 
a  series  of  experiaental  investigations  of  adaptive  coaputer- 
aided  control  and  task  allocation. 


Davis,  P.  H,  Nan-aachine  coamunlcation.  Annaal  Revj.ew  of  Infer;; 
lalisa  Sclsase,  aai  Technology.  1965,  22'l-2?47 


This  is  t-he  first  annaal  review  of  +-he  field  of  man-»achine 
conaanication.  Accordingly,  it  has  no  prior  context  in  which 
to  frame  itself.  To  achieve  cohesiveness,  it  has  beer 
necessary  to  cite  work  of  earlier  years  when  no  1965 
literature  was  found  as  illustrative  of  a  particular  topic 
being  addressed.  The  review  is  selective  in  its  references. 
Of  some  210  documents  that  were  scanned,  only  aproximateiy 
50%  are  cited.  The  criteria  for  selection  were  varied  and 
were  rigorously  followed  only  within  the  limitations  of  human 
error.  Those  documents  cited  either  (1)  contained  excellent 
descriptions  of  particular  applications,  equipment  or  problem 
areas;  (2)  provided  comprehensive  coverage  of  a  particular 
topical  area;  (3)  advanced  a  particular  method  of  approach  or 
concept  to  which  attention  needed  to  be  drawn;  or  (4) 
themselves  highlighted  a  point  the  reviewer  wished  to  aake. 
Foreign  literature  was  surveyed  bu^  little  was  found  that  me+- 
the  selection  criteria.  Equipment  and  programainq  languages 
were  intentionally  neglected  because  of  their  inclusion  in 
other  areas  of  this  Annual  Peview. 


Durding,  B.  «.,  Becker,  C.  A.,  and  Gould,  J.  D.  Data 
organixation.  Hupan  Factors.  1977,  J[9,  1-14. 


Three  exporimerts  investigated  how  people  organize  data. 
Subiects  were  giver  sets  of  15-20  words  and  asked  to  organize 
them  on  paper.  Each  word  set  has  a  pre-defined  organization 
(hierarchy,  network,  lists,  table)  based  on  the  semantic 
relations  among  the  words.  Experiment  1  showed  that  college 
students  have  all  these  organizational  structures  available 
for  use.  They  organized  most  word  sets  on  the  basis  of  the 
semartic  relations  inherent  in  th^m.  Whereas  most  subiects 
used  ”appropriate"  organizations  (those  that  most  easily 
preserved  the  relations),  a  few  subiects  organized  nearly  all 
word  sets  into  lists.  Experiment  2  showed  that  subiects  can 
efficiently  fit  word  sets  into  "skeletons"  that  were 
explicitly  designed  to  maintain  all  the  semantic  relations 
among  the  words.  Experiment  3  showed  that  subiects  have 
difficulty  in  preserving  the  relations  among  the  words  when 
they  were  required  to  organize  them  into  inapprooriat e 
stri’cturgs,  Thesp  results  are  oyaluatcd  relative  to  the  use 
cf  romouter-hased  information  retrieval  systems. 


Edvards,  B.  and  Lees,  F.  p.  The  inflnerce  of  the  process 

characteristics  on  the  role  of  the  huvan  operator  in  proc=»ss 
con+rol.  Applied  Frqonovlcs.  197l|,  5  (I)  ,  21-2S, 


Pational  design  of  a  process  control  systev  using  an  on-line 
covputer  requires  a  definition  of  the  total  control  task  and 
an  allocation  of  function  between  the  huvan  operator  and  the 
■acfaine.  Roth  the  nature  of  the  to^-al  task  and  its 
subdivision  depend  very  vuch  on  the  process  characteristics, 
which  vary  widely  between  different  processes.  The  functions 

norvally  perforued  by  a  process  control  computer  are 
described  and  those  consequently  left  to  the  operator  are 
defined.  The  wide  variety  of  the  operator's  functions  and 
the  implications  of  this  for  s'-udies  of  the  operator's 
performance  and  for  the  design  of  the  man-machine  interface 
are  emphasized. 


lisle,  J.  E.,  iilliges,  R.  c.,  and  poscoe,  S.  W.  The  isolation  of 
minimum  sets  of  visual  imaoe  cues  sufficient  for  spatial 
orientation  during  aircraft  landing  approaches.  savoy, 
Illinois:  nniversity  of  Illinois  at  nrbana-Champaign , 

Aviation  Research  Laboratory,  Technical  Report, 

ASL-76-16/01IR-76-3,  November,  1976. 


An  experimental  investigation  of  synth^^tic  imaging  displays 
was  directed  toward  the  isolation  of  minimum  sets  of  visual 
cues  sufficient  for  spatial  orientation  in  ground-referenced 
aircraft  landing  approaches.  Thirty-two  flight  instructors 

viewed  static  computer-generated  airport  scenes  TV-proiected 
onto  a  large  screen,  viewed  from  the  cockpit  of  a  twin-engine 
general  aviation  trainer.  Judgments  of  lateral  and  vertical 
deviations  from  a  four-degree  approach  to  landing  aim  point 
in  the  display  were  made  to  32  combinations  of  four  contact 
analog  cues:  runway  outline,  runway  touchdown  zone,  runway 
centerline,  and  ground  plane  texture;  and  one  guidance  cue: 
glidepath- localizer  symbol.  Each  resulting  display  was 
responded  to  once  or  more  from  each  of  27  different  flioht 
position  and  attitude  viewpoints  by  each  of  eight  subderts  in 
different  serial  orders.  Dependent  measures  were  response 
choice  and  response  latency.  The  most  accurate  glidepath  and 
course  deviation  judgments  were  made  when  the  guidance  cue 
glidepath  was  in  the  set.  When  only  contact  analog  cues  were 
present  the  best  judgments  of  spatial  orientation 
consistently  were  made  when  the  runway  outline  was  present  at 
far  and  medium  ranqes  from  touchdown  and  when  the  runway 
centerline  was  present  at  near  range. 


Enqf>I,  S,  B,  and  Gran  da,  p.  E,  Goidolines  for  nan/display 

intf>rfaces.  Poaqhkeepsie,  Eew  Terk;  International  Basinoss 
Hachines,  Report  Ho.  TR  00.2720,  Dececber,  1975. 


This  report  docuaents  a  set  of  hnnan  factors  guidelires; 
rela+inq  to  the  interface  between  a  nser  of  an  interartiwe 
conpntrq  system  ard  a  display  terminal  connected  to  ♦•he 
sys’-<»n.  Thonqh  intended  primarily  for  th®  nse  of  developers 
of  software  for  an  interactive  system,  many  of  the  guidelines 
should  be  of  interest  to  hardware  developers,  areas  covered 
include  display  frame  layout,  frame  content,  command 
languages,  error  prevention  and  recovery,  response  tines,  and 
behavioral  principles. 


Enstrcm,  K.  D.  Real  time  adaptive  modeling  of  the  human 

controller  with  application  ♦o  nan-computer  interaction. 
Or bana-Chanpaign,  Illinois:  Oniversity  of  Illinois  at 

Orbana-chanpaign ,  Coordinated  Science  Laboratory,  Report  No. 
R-715.  OILO-BHG-76-2203,  January,  1976. 


When  a  human  and  computer  are  ioined  forming  a''- human-computer 
system,  the  two  decision-makers  must  work  together  if  ♦rh® 
hunan*s  workload  is  to  be  reduced  and  overall  system 
performance  maintained  or  improved.  Independent  actions  by 
each  decision  maker  could  prove  to  be  counterproductive. 
This  thesis  proposes  that  cooperation  between  decision  makers 
can  be  fostered  by  using  the  computer  to  monitor  the  actions 
of  the  human,  •’’he  human  can  act  freely,  and  the  computer 
will  use  decision  policies  that  do  not  conflict  with  th<^ 
human's  current  actions,  but  adapt  to  them. 


Enstrcm,  K.  0,  and  Rouse,  V.  B.  Real-time  determination  of  hew  a 
human  has  allocated  his  attention  between  control  and 

monitoring  tasks,  IEEE  Tgapjsactions  03  Systems,  flin,  and 
Cybernetics,  1977,  ?HS-7,  3,  153-161, 


k  computer  algorithm  employing  fading-memory  system 
identification  and  linear  discriminan'-  analysis  is  proposed 
for  r*»al-time  detection  of  human  shifts  of  attention  in  a 
control  and  monitoring  situation.  Erperivental  results  are 
presented  that  validate  the  usefulness  of  the  method. 
Application  of  the  method  to  computer-aided  decision-making 
in  multitask  situations  is  discussed. 


Brans,  R,  C,  and  flillftr,  L.  A.  STABCAT,  a  systea  to  analyze 

intt^ractize  CHS  perforaance.  Torktown  Relahts,  Hew  York,  IWH 
Thoaas  J.  Hatson  Research  Center,  Report  Ho,  PC  7072  (# 

30  31ft),  April,  1978. 


This  paper  describes  a  software  systea  naaed  STARCAT  -  for 
STreaa  Analysis  of  Responses  by  CATeqory.  The  systea 
analyzes  sequences  of  user  coaaand  strings  that  have  beer 
captured  in  a  special  tiaestaaped  CHS  console  file;  user 
response  tines,  ORTs,  and  systea  response  tines.  SRTs,  are 
associated  with  each  string;  strings  are  assigned  -  by 
conaand  nane,  enwironaent,  or  ezperiaenter-chosen  groupings  • 
into  categories;  and  category  sta*-istics  are  reported  for 
one,  two,  and  three-string  subsequences.  STARCAT  provides  a 
new  tool,  valuable  to  various  interface  and  systea  design 
studies,  for  the  quantitative  analysis  of  interactive 
terninal  perforaance. 


Fetter,  R.  B,  Han-coaputer  interaction  in  a  decision-naking 

enviroraent.  Hew  Haven,  Connecticut;  Tale  University, 
Bepartnent  of  Adninistrative  Sciences,  Annual  Report  Ho.  1, 
February  1,  1970  -  Janury  31,  1971. 


An  ezperiaent  was  fornuXated,  conducted,  and  results  reported 
involving  video  and  teletype  consoles  in  an  inforaa+ion 
retrieval  environaent.  In  conjunction  with  the  developaen^ 
of  at  inforaation  systea,  a  capability  to  siaulate  a  variety 
of  prohlea  solving  environaents  and  autoaatically  evaluate 
results  was  designed  and  prograaaed.  This  included  the 
ability  to  give  users  on-line  feedback  of  their  relative 
effectiveness.  Basic  inforaation  relevant  to  further 
research  was  gathered,  including:  a  bibliography  of  research 
in  aan-coaputer  interaction;  and  a  file  of  inforaation  on 
available  coaputer  consoles. 
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Planaqan,  J.  L.  ro«pu^-*»rs  that  talk  and  lister:  nan-machine 

communication  by  Toice.  proceedings  of  the  TEBP,  kpril, 
1976,  64  (4)  ,  405-415. 


computer  techniques  now  emerging  in  the  laboratory  promise 
new  capabilities  for  voice  communication  between  man  and 
machine.  Three  nodes  of  interaction  are  of  special  interest: 
computer  voice  readout  of  stored  information,  automatic 
verification  of  a  caller's  identity  by  means  of  his  voice 
signal,  and  automatic  recognition  of  spoken  commands, 
Applications  extend  to:  voice-directed  installation  of 
telephone  equipment,  authentication  by  voice  of  a  credit 
customer  or  of  an  individual  requesting  readout  of  privileged 
information,  and  voice-controlled  services  such  as  repertory 
dialing  or  automatic  booking  of  travel  reservations. 


Fleishman,  F.  A.  Performance  assessment  based  on  an  empiricallv 
derived  task  taxonomy.  Human  Factors.  1967,  9,  349-366. 


This  report  reviews  and  discusses  a  number  of  ■►he 
methodological  gu“stions  relating  to  the  application  of  ar 
experimental  correlational  approach  to  the  problem  of 
assessing  complex  performance.  The  basic  point  of  departure 
is  the  specification  of  the  requirements  for  a  task  taxonomy 
and  an  analysis  of  the  value  of  factor  analytic 
investigations  in  combination  with  experimental  methods  in- 
providing  the  frame-work  for  such  a  taxonomy.  The  way  in 
which  this  aoproach  has  been  applied  in  the  past  and  the 
expected  benefits  of  its  successful  implementation  are 
discussed.  Tt  is  concluded  that  experimental  -  correlational 
studies  offer  considerable  promise  in  attacking  complex 
performance  but  that  a  more  extensive  research  program  is 
needed.  The  general  outlines  of  such  a  program  is  described. 
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Foley,  J.  0.  The  haaan  fac+ors  -  coaput^r  graphics  irterfac®, 

Washington,  D.C.:  The  Georae  Washington  OniTersity, 
Departaent  of  Flectrical  Engineering  and  Coapoter  Science, 
June,  1978. 


Host  Interactive  Coapoter  Graphics  Applications  (ICGA)  in  use 
today  have  been  developed  with  absolutely  no  help  froa  huaan 
factors  specialists.  This  situation  is  frustrating  to  all  of 
os  who  recognize  that  good  h':ean  engineering  can  be  central 
to  the  success  of  an  appliction.  The  cause  of  this  dileaaa 
is  ezaained,  and  several  reaedies  are  prescribed.  The 
process  of  designing  an  ICGA  is  described  to  illustrate  the 
role  of  huaan  factors  engineering  at  each  step  of  the  design 
process,  and  to  suggest  a  conceptual  fraaework  within  which 
current  huaan  factors  knowledge  aight  be  structured  and 
future  research  night  be  perforaed. 


Foley,  J.  D.  and  Wallace,  V.  L.  The  art  of  natural  graphic 

aan-aachine  conversation.  Proceedings  of  the  IEEE.  62  (h| , 
April,  1974,  462-471. 


The  design  of  interactive  graphic  systeas  whose  aia  is  good 
symbiosis  between  man  and  machine  involves  numerous  factors. 
Hany  of  those  factors  can  be  judged  froa  the  perspective  of 
natural  spoken  conversation  between  two  people.  Guiding 
rules  and  principles  for  design  of  such  systeas  are  presented 
as  a  fraaework  for  a  survey  of  design  techniques  for  aan- 
aachine  conversation.  Attention  is  especially  focused  on 
ideas  of  action  syntax  structuring,  logical  equivalences 
among  action  devices,  and  avoidance  of  psychological  blocks 
to  coaaunication . 


Frederico,  P.  A.  Computer-based  management  information  systems: 

Is  there  really  an  "information  glut?"  Proceedings  of  t^e 
HSME  Factors  Society.  19th  Annual  Heeting,  Dallas,  Texas, 
1975. 


Some  salient  issues  are  Identified  and  discussed  concerning 
ooaputer-based  manageant  information  and  decision  systems  and 
managerial  behavior.  The  literature  in  this  area  is  very 
inconsistent  and  uncertain  with  respect  to  the  alleged  impact 
of  these  automated  systems  upon  managerial  information 
processing  and  decision  aakirg.  This  underscores  the  almost 
ooaplete  absence  of  eapirical  data  regarding  the  implications 
of  these  systeas  for  managerial  behavior.  Research  should  be 
initiated  to  explore  eapirically  what  the  inpacts  of 
computerized  infornation  systems  are  for  aanageaent. 


Preandf  P,  J.  and  Hartley#  H.  O.  \  procedure  for  automatic  da^a 

editinq.  American  Statistical  Association  Journal.  62 

<318),  341-352." 


Since  raw  data  from  sample  surweys  and  experiments  oft^r 
cor«-air.  errors,  at+empts  are  usually  made  to  edit  data  *-r> 
make  them  more  useful  for  analytic  purposes.  Increasinq 
portions  of  this  editing  are  now  being  accomplished  by  high 
speed  computers.  The  great  variety  of  such  procedures 
reflects  the  conflicting  desires  of  providing  editing 
procedures  which  recognixe  peculiarities  of  particular  data 
sets  and  yet  are  easily  programmed  and  implemented.  This 
paper  proposes  a  scheme  which  is  hoped  to  be  suitable  for  a 
large  variety  of  sample  and  survey  data  and  yet  be  relatively 
easy  to  implement  once  a  general  program  has  been  written. 


Galitx,  H.  0.  and  Laska,  T.  J.  computer  system  peripherals  and 
the  operator.  Computer  Design.  August,  1969,  1.2,  52-56. 


Little  effort  has  been  directed  toward  increasing  the  under¬ 
standing  of  the  role  cf  the  (computer)  operator  in  tj^o 
system.  Observing,  measuring  and  understanding  his  behavior 

is  essential  if  systems  engineered  and  designed  for  humans 
are  to  be  developed.  Highlights  of  a  study  of  the  computer 
operator's  relationship  to  peripheral  devices  is  presented 
here. 


Gallenson,  L.  An  approach  to  providing  a  user  interface  for 

military  computer-aided-instructior.  in  1980.  Harina  del  Fey, 
California:  Harina  del  pey  Information  Sciences  institute, 
Feport  No.  IS/PR-75-43,  November,  1975. 


A  recent  needs  study  determined  that  most  of  the  torminal 
requirements  for  military  CAI  applications  can  be  satisfied 
with  mainstream  commercial  terminals.  Additional 

development,  however,  is  likely  to  he  required  to  satisfy  *:wo 
cf  capabilities  (limited  graphics  and  orerecerded 

visuals).  The  expected  architecture  of  commercial  tatminals 
will  make  it  easy  to  modify  and  customize  them  to  meet  all 
the  identified  CAI  needs.  The  military  community  is  also 
expected  to  use  computer  networks  to  satisfy  an  appreciable 
portion  of  its  requirements.  Commercial  terminals  and 
available  computer  networks  provide  the  basis  for  an 
effective  and'  economical  user  interface  to  military  CAT 
systems. 


Oarvin,  P,  L.  Lanqaag»  and  aachines.  Tntornational  Science  and 
Tech  no  log  T.  flay,  1967,  63-9fl, 


natural  lanquag"*  research  attempts  to  siaplify  nan's  proMeas 
of  connunicating  with  nachines  or  through  nachines  via 
aotonatic  translation.  Qusry  languages  resenble  natural 
language  and  enable  conputers  to  conpose  answers  to  a  United 
variety  of  questions.  But  synonony  of  words  is  frequently 
conditional,  so  conputer  proarans  nust  recognize  senantic 
anbiguities  and  syntax  as  well  as  have  large  dictionaries. 
The  automatic  translation  possible  now  is  really  machine- 
aided.  There  is  strong  disagreement  whether  development  of  a 
theory  of  language  should  precede  the  engineering  of  a 
reliable  methodology  for  machine  translation,  for  successful, 
if  not  perfect,  data  processing  can  be  based  on  empirical 
knowledge. 

Gould,  J.  D.  Visual  factors  in  the  design  of  computer-controlled 
CBT  displays.  Human  Factors.  1968,  JO,  359-176. 


This  paper  is  concerned  with  the  important  visual  variables 
that  determine  image  quality  on  computer-controlled  CPT 
displays.  K  strategy  is  developed  that  leads  to  general 
conclusions  about  each  variable  even  though  most  of  these 
variables  interact.  For  each  variable  considered,  the 
recommended  range  of  values  is  determined  on  the  basis  of 

experimental  evidence  and  is  compared  with  the  values 
presently  used  on  displays.  Where  discrepancies  between 

these  two  exist,  alternative  solutions  are  mentioned. 
Conclusions  are  (i)  presently  used  values  of  display 
luainance,  chroaaticity  (color),  and  resolution  are  adequate; 
(ii)  several  displays  flicker;  (iii)  characters  are  large 
enough  but  aay  be  marginal  in  terms  of  number  of  eleBer*s; 
(Iv)  luminance  con'-rast  is  not  adequate. 
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Gould,  J.  D.  Sole  psychological  ^vid^nce  on  hov  people  debnq 

coaput^r  prograas.  International  Jourral  of,  Han-wachine 
Studies,  1975,  7,  151-182. 


Ten  experienced  prograeaers  were  each  given  the  saae  1? 
FOPTPAN  listings  to  debug,  Fach  listing  contained  a  non- 
syntactic  error  in  one  line,  Median  debug  tiaes  (7  air.)  , 
nuaber  of  bugs  not  found  (11*  of  •♦•he  listing),  and  nuaber  of 
incorrect  assertions  about  the  location  of  the  bug  (less  than 
one  per  listing)  all  replicated  earlier  results  (Gould  f. 
Drongowslci,  197U)  ,  although  subjects  were  givar.  the 
opportunity  to  use  the  interactive  debugging  facilities  of  an 
on-line  computer,  *hey  rarely  did  so.  Bugs  in  assignment 
statements  were  about  three  times  as  hard  to  detect  as  array 
or  interaction  bugs.  Debugging  was  about  ♦■hr®®  times  as 
efficient  or.  programs  subjects  had  debugged  previously 
(although  with  a  different  bug).  A  nnmber  of  basic  concepts 
and  a  gross  theory  of  debugging  is  described. 


Gould,  J,  D.  and  Ascher,  R.  M.  Use  of  an  IQP-like  guery  language 
by  non-programmers.  Yorktowr  Heights,  Mew  vork;  TBH  Thomas 
J,  Watson  Research  Center,  Behavioral  Sciences  Group, 
Computer  Sciences  Department,  Report  Mo,  RC-5279  (12316.1)  , 

February,  1975, 


This  exploratory  experiment  attempts  to  examine  separately 
the  formulation,  planning,  and  ceding  of  queries,  college 
students  and  file  clerks  required  about  ten  hours  to  learn  a 
query  language  which  was  somewhat  similar  to  IBM’s  lOR  query 
language,  but  contained  more  function.  They  were  then  giv®n 
15  test  problems  that  varied  in  complexity  and  how  well  th*y 
were  expressed.  Subjects  were  required  to  formulate,  then  to 
plan  (writing  each  in  their  own  words) ,  and  finally  to  cod® 
each  problem.  Results  provide  some  suggestions  about  which 
problem  variables  affected  which  stages  in  writing  gu®rl®s. 
For  example,  whether  or  net  a  problem  was  well  expressed 
seemed  to  affect  problem  formulation  time,  but  had  no  aff^'ct 
upon  problem  planning  or  problem  coding  times.  Specific 
language  constructions  (additions  to  IPF) ,  such  as  contextual 
referencing  and  a  new  method  to  handle  limited  disjunctive 
problems,  were  shown  to  be  useful,  Thr  types  of  coding 
errors  that  subjects  made  were  identified  end  discussed. 
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Goald,  J.  0.  and  Boies,  S,  J,  Bri+^ing,  dictatirg,  ard  speaking 

letters.  Torktown  Heights,  New  fork:  IBH  Thosas  J,  Hatson 

Nesearch  Center,  Report  No.  PC-668.1  (#28698)  ,  August,  1977. 


This  research  aims  at  understandirg  psychological  processes 
in  docuaent  composition,  particularly  in  dictation,  through 
•easureaents  of  authors*  actual  performance  and  th°ir 
perception  of  their  perforaance.  it  is  commonly  assumed  that 
dictation  requires  a  long  time  to  learn  but  authors 
ewertnally  become  much  faster  than  with  writing.  Evidence 
presented  here  suggests  this  is  rot  true,  although  authors 
believe  this  to  be  the  case  about  their  own  performance. 
Novice  dictators  learned  in  a  few  hours  to  dictate  with  the 
same  speed  and  quality  as  they  wrote;  expert  dic*-ators  wer*' 
cnly  0-2*>ll  faster  than  novices,  depending  upon  the  complexity 
of  the  letters. 


Gould,  j.  D.  and  Drongowski,  p.  An  exploratory  study  of  computer 
prooram  debugging.  Human  Factors.  197tt,  258-277. 


This  experiment  represents  a  new  approach  to  the  study  of  the 
psvchology  of  prooraamlng,  and  demonstrates  the  feasibili^-y 
of  studying  an  isolated  part  of  the  prograaaino  process  in 
the  laboratory.  Thirty  experienced  FORTRAN  programmers 
debugged  12  one-page  FORTRAN  listings,  each  of  which  was 
syntactically  correct  but  contained  one  non-syn.tactlc  error 
(bug).  Three  classes  of  bugs  (Array  bugs.  Iteration  bugs, 
and  bugs  in  Assignment  Statements)  in  each  of  four  different 
programs  were  debugged.  The  programmers  were  divided  into 
five  groups,  based  upon  the  information,  or  debugging 
••aids*',  giver,  them.  Key  results  were  tha*-  debug  times  were 
short  (median  =  6  min).  The  aids  groups  did  not  debug  faster 
than  the  control  group;  their  debugging  strategies  based  upon 
the  information  available  to  them.  The  results  sugges*-  that 
programmers  often  identify  ♦he  intended  state  of  a  program 
before  they  find  the  bug.  Assignment  bugs  were  more 
difficult  to  find  than  Array  and  Iteration  bogs,  probably 
becanse  the  latter  could  be  detected  from  a  high-level 
understanding  of  the  prograamirg  language  itself.  Debugging 
was  at  least  twice  as  efficient  the  second  time  programmers 
debugged  a  program  (though  with  a  different  hug  in  !♦)  .  A 
simple  hierarchical  description  of  debugging  was  suggested, 
and  some  possible  ••principles"  of  debugging  were  identified. 
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Gould,  J.  P.,  Lewis,  C. ,  and  Becker,  C,  h,  Britinq  and  followinq 
procedural,  descriptiwe  and  rertricted  syntax  lanquaqe 
in structiors.  Torktown  Heiqhts,  Hew  fork:  IBB  Thosas  J. 
Batson  Research  Cen+-er,  Report  Bo.  PC-5<»43  (i?57Sl)  ,  kpriT, 
1976. 

Two  exploratory  experlsents  coepared  the  way  people  (with  no 
experience  in  the  use  of  coeputinq  systess)  write  and  carry 
out  natural  lanquaqe  procedures,  natural  lanquaqe 
descriptions,  and  instructions  expressed  in  an  artificial 
restricted  syntax  lanquaqe..  The  results  suqges*  that  ther® 
is  no  single  'natural*  way  that  people  write  sisple  plans  and 
instructions.  Speed  and  accuracy  of  writing  were  about  the 
saae  for  all  three  approaches,  although  the  linguistic 
characteristics  differed  greatly  fros  approach  to  aoproach. 
While  subjects  were  tolerant  of  aabiquity  both  in  writing  and 
in  carrying  out  Instructions,  they  often  voluntarily  employed 
restricted-syntax  notation  in  their  writing  after  being 
exposed  to  the  notation.  Subjects'  accuracy  in  followino 
detailed  instructions  was  nc  greater  than  that  in  writlna 
those  instructions. 


Grignef-i,  B,  C.  and  Hiller,  D.  C.  Inforsation  processing  wodels 
and  coaputer  aids  for  hunan  performance.  Task  2,  Models  of 
haaan-coapater  interaction.  Caabrldge,  Massachusetts:  Bolt, 
Beranek,  and  Bewaan,  Inc.,  Report  Bo,  BBM-2186,  June,  1971, 


Experiaents  were  conducted  to  explore  methods  of  aotivatinq 
tiae-ahring  users  to  adopt  behavior  patterns  that  improve 
overall  system  performance.  It  was  found  that  while  it  is 
indeed  possible  for  a  time-sharing  system  ♦•o  provide 
incentives  to  users  that  will  affect  their  choices  between 
alternatives  methods  of  accomplishing  a  given  task,  the 
extent  of  this  effect  is  no'-  entirely  predictable.  klso 
designed  and  implemented  was  a  measuring  system  for  the 
SDS-9ttO  time-sharing  computer  system.  This  measuring  system 
yielded  data  that  were  useful  In  increasing  an  understanding 
of  the  dynamic  behavior  of  programs  in  a  time-sharing  sys*em 
and,  more  specifically,  in  improving  overall  system 
performance. 
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KriqnPtti,  H.  C. ,  Biller,  D.  C,,  Bickersor,  P.  S, ,  and  Pew,  H. 
Inforaation  processing  podels  and  copputer  aids  for  hnnan 
pcrfornance.  Task  2.  Hanan-coapnter  interaction  nodels. 
Canbridqe,  Bassachnsetts:  Bol+,  Berarek,  and  Mewaan,  Inc. 

Report  Mo.  BBM-2190,  June,  1971. 


A  neasurinq  systen  was  inpleaented  to  obtain  the  statistical 
paraneters  necessary  ♦o  specify  a  oneueirq  theory  nodel  of 
the  dvnaaic  behavior  of  a  state-of-the-art  tine-shared 
conputer  systen,  and  present  results  on  the  sta*is*ics  of 
usage  of  one  such  conputer  systen.  A  nethodoloqy  is 

presented  for  the  perfornance  of  experinents  involvino  hunar 
users  and  for  ♦he  interpretation  of  their  results.  It  is 
expected  that  these  results  will  yield  predictive  nodels  for 
the  overall  efficiency  of  the  • users-ronputer  systen'  under 
various  circunstances. 


Grines,  F.  B.  and  Otto,  R,  E.  A  study  of  sone  software  parameters 
in  tiue-sharing  svstens.  Onpubllsted  nas^er's  thesis,  Maval 
Postgraduate  School,  Honterey,  California,  1965. 


A  review  is  nade  of  sone  existing  tine-sharino  conpo'-er 
systens  and  an  exploration  of  various  software 
characteristics  is  conducted.  This  investigation  is 
conducted  using  a  conputer  progran  with  which  a  typical  tin®- 
sharing  systen  can  be  sinolated.  The  basic  systen  parameters 
exanined  are:  (1)  the  method  of  deternining  the  quantum  time 
for  each  user  per  response  cycle,  {2}  the  length  of  the 
desired  response  cycle,  (3)  the  number  of  remote  stations 
permitted  and  (R)  the  maximum  number  of  users  permitted  in 
the  queue  at  one  tine.  The  results  of  these  simulation  runs 
are  presented.  The  effects  of  the  various  parameters  upon 
the  average  response  cycle  time,  the  average  number  in  the 
queue  awaiting  service,  the  average  length  of  time  a  user  is 
in  the  queue  and  the  computational  efficiency  plus  other 
characteristics  of  the  system  are  discussed. 
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Grossfc^ra,  l*. ,  Hies->p,  P.  A.,  arfl  Ynto*?,  n,  b.  Ac  Pxo=ri«'»c*-  or 
proble*  solTir.q  uith  d»lay<5d  roBpo^er  rosner.«?as. 

Transa colors  or,  STstgns.  Har,  ard  CYb^rnotics.  <i  C'lT 

219-227. 


Four  sufciects  eclv^d  prohl^ws  or  lire  wiOh  **’»  Tincolr 
laboratory  Pockor.^r.  Cor.^rollPd  d«=lays  waro  int®rpof^'=d 
between  outout  romsacds  and  the  reFulticq  outputs,  which  were 
wia  typewriter,  ca*’hcde-rav  ♦•ube  (CYT)  ,  or  line  prirter; 
ether  coanands  were  execoted  promptly  and  without  reply,  the 
•ear  delay  was  1,  4,  16,  or  64  seconds,  with  individual 

delays  varying  widely  and  urpr® dic*-ablv  about  ^he  vean.  Pa*-* 
cn  nic*'  problems  per  delay  oer  suhjec*  shewed  ♦•ha*'  at  lona^r 
delays  th®  rate  of  which  commards  were  giver  decrease'’, 
especially  the  rate  of  output  commands,  and  that  the  problems 
were  solved  with  fewer  outputs  in  about  the  same  *-ime.  Wi^h 
tyo  subjects,  th^re  was  a  marked  effect  of  d‘=lay  on  ♦he 
relative  freqae»'cy  of  use  of  the  thr^e  output  devices. 


Harris,  i.  p.  Natural  language  data  base  guery:  Usirg  the  data 

base  itself  as  th®  definition  of  world  knowledge  and  as  ar 
extension  of  the  dictionary.  Hanover,  New  Hampshire': 
Dartmou*:h  Collene,  neoartmen*  of  pathewatics,  Peport  No.  T" 
77-2,  Yehruary,  1977. 


This  paper  raises  ‘wo  issues  ♦ha*  heretofore  have  not  bean 
deal*  with  ir  any  pteyious  natural  lanouage  data  base  query 
system.  These  issues  arise  because  of  the  ey^rpresen*-  rea,^ 
for  world  knowledge  in  the  understanding  of  English,  and  also 
because  of  the  particular  way  in  which  information  is  stored 
in  a  data  base,  Th®  solutions  to  these  problems  described  in 
this  oaoer  require  only  exis«-ino  stat^  of  the  ar*  data  bas'^ 
technology. 


Heafner,  J,  F.  K  ae^hodology  for  selecting  and  refining 

■an-coBpater  languages  to  iaprove  users*  perforaance.  Marina 
del  California:  Marina  del  Rey  Inforaatlon  Sciences 
Institute,  Report  No.  ISI/RR-7a-21,  Septeaber,  1974, 


This  report  describes  a  methodology  (supported  by  a  softwar*=^ 
package)  to  aodel,  aeasure,  analyze,  and  evaluate  users* 
performance  in  a  message  coaannication  system  environment. 
The  theses  of  the  report  are;  1,  that  models  of  users  and 
services  can  be  accorately  used  as  predictors  it  selecting  a 
language  form,  for  an  application,  which  will  result  in  high 
users*  performance,  and  2.  that  such  a  language  fora  is  only 
an  approximation  (in  terms  of  yielding  optimal  user’s 
performance)  due  to  within  variances  of  user  and  service- 
classes,  hence  individual,  on-line  regulation  of  language 
constructs  is  necessary  to  further  improve  performance.  This 
report  develops  appropriate  models  and  algorithms,  and  states 
hypotheses  relating  the  interactive  effects  of  users, 
services,  language  forms,  and  other  variables  important  in 
man-machine  discourse.  An  experiment  design  is  presented, 
which  tests  the  major  hypotheses. 


Hitt,  H.  D. ,  Schutz,  H,  G.,  Christner,  C,  A.,  Pay,  H.  w.,  and 

Coffey,  J.  1.  Development  of  design  criteria  for 
intelligence  display  formats.  Human  Factors,  1961,  3,  86-92. 


A  broad  research  program  to  develop  design  criteria  for 
intelligence  display  formats  is  outlined  and  the  general 
findings  of  the  program  are  discussed.  Five  specific  areas 
of  investigation  are  selected  for  study;  a  comparison  of 
vertical  and  horizontal  arrangements  of  alpha-numeric 
material,  an  evaluation  of  formats  for  trend  displays,  an 
evaluation  of  me*- hods  for  presen*- ation  of  graphic  multiple 
trends,  an  evaluation  of  five  abstract  coding  methods,  and  an 
evaluation  of  the  effec-*  of  selected  combinations  of  targe* 
and  background  coding  or  nap  reading  performance.  The  five 
succeeding  articles  treat  the  five  areas  of  investigation  in 
detail. 


Jordan,  N.  ^Motivational  problems  in  human-computer  operations. 
Human  Factors,  1962,  U,  171-175. 


In  designing  machines  and  man-machine  systems.  Human  ^actors 
Engineering  has  oererally  concentre ♦•ed  upon  seeking  solutions 
to  physiological  problems  to  enable  the  human  operator  to 
function  efficiently.  It  has,  however,  neglect=d  ^he 
psychological  problems,  particularly  the  problems  of 
motivation.  This  was  not  too  critical  as  long  as  machines 
were  "primitive.”  with  the  advert  of  automation  and  complex 
man-machine  systems  this  neglect  may  have  most  ond»sirabl«» 
effects.  An  attempt  is  made  to  identify  the  necessary 
conditions  which  make  a  task,  per  se,  motivating.  Examples 
are  cited  from  some  new  systems  where  some  of  these  necessary 
conditions  are  lacking  and  the  effect  of  this  lack  upon  th«» 
operator  is  indicated. 


Kane,  D.  F. ,  Jr.  observational  research  in  user-computer 

interaction.  Perkeley,  California:  Lawrence  Berkel-^y 
Laboratory  and  Energy  Research  and  Development 
Administration,  Peport  So.  CONF-7510100-1,  October,  1975. 


This  paper  is  primarily  concerned  with  methodology  in  this 
field  of  research.  First,  the  nature  of  user-computnr 
interaction  in  information  systems  is  described,  and  viable- 
types  of  research  are  sugoested.  Then  the  observational 
methodology  of  heuristic  development  is  presented,  and 
value  both  of  teamwork  and  of  evolutionary  development  i 
discussed.  Next,  the  management  context  at  the  Lawrenc 
Berkeley  Laboratory  is  described.  Finally,  some  measures  of 
success  are  discussed,  as  exemplified  by  the  expanding  use  of 
the  Budget  Hanagement  Sys'*-em  in  the  Lawrence  Berkeley 
Laboratory  Management  Information  System. 
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Kelley,  C.  P.  Manual  and  autouatic  control.  Hew  York:  Wil  ?v, 
1968. 


This  book  presents  a  theory  of  the  huiran  control  proccsp  in 
■an/machine  systems.  Klso,  manual  control  system 

applications  are  discussed  in  a  technically-oriented 
approach.  Implications  of  the  control  theory  for  automatic 
control  are  examined.  Chapter  tl<-les  include  the  followinq: 
The  control  process,  the  control  system,  the  control  system 
hierarchy,  the  human  operator:  consciousness  and  planninq  in 
the  control  process,  the  human  operator:  motor  performance, 
adaptation  and  optimization  bv  the  human  operator, 

information  requirements  and  receptor  channels,  sta^-us 

displays,  displays  and  control  augmentation:  command 

displays,  historical  and  predictor  displays,  techniques  of 
adaptive  manual  control,  controls,  engineering  models  of 
human  operator,  predictive  and  review  models  of  the  human 
operator,  the  7,iebolz  automatic  controller,  and  the  role  of 
man  in  automatic  control  processes. 
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Kelly,  (1.  J.  Studies  in  interactive  coenanication:  Limited 

vocabulary  natural  lanauaqe  dialooue.  Baltimore,  flaryland: 
Johns  Hopkins  University,  Department  of  Psychology,  Report 
Ho.  TR-3,  August,  1975. 


The  complexity  and  costs  of  interactive,  natural-language 
computer  systems  could  be  reduced  if  the  man-coaputor 
communication  used  only  a  limited  subset  of  the  Rnglish 
languaoe.  The  purpose  of  this  study  was  to  test  ♦h^- 
hypothesis  that  people,  although  accustomed  to  unrestricted 
use  of  the  language,  can  efficiently  interact  using  a 
carefully  chosen  subset  of  a  few  hundred  words.  Two-person 
teams  communicated  through  a  computer-controlled 
teletypewriter  system  to  cooperatively  solve  real-world 
problems.  They  were  permitted  to  use  only  words  on 
pradetermined  lists  of  300  words,  of  500  words,  or  as  a 
control  condition,  with  no  vocabulary  restrictions.  The 
teams  solved  a  different  problem  on  each  of  three  succf^ssive 
days.  Dependent  measures  were  taken  or  four  classes  of 
variables:  (1)  time  to  solve  the  problem,  (2)  several 
measures  of  overt  behavior,  (3)  several  measures  of  verbal 
output,  and  (4)  measures  of  errors  made  by  subjects  using  th® 
two  restricted  vocabularies.  There  were  numerous  significant 
effects  of  the  Problems,  the  Job  roles  of  subjects  within  the 
team,  and  the  Problem  X  Job  Role  interaction.  However,  ^he 
more  interesting  main  effect  of  Vocabulary  Site  was 
significant  for  only  three  of  the  21  dependent  measures. 
Fur-’'hermore,  only  four  of  the  105  interactions  involving 
Vocabulary  Size  were  statistically  significant.  This  study 
presents  strong  evidence  of  the  adaptability  of  the  human 
communicator.  Although  sometimes  exhibiting  frustration  with 
the  small  vocabularies,  the  subjects  were,  nonetheless,  able 
to  solve  their  problems  about  as  successfully  as  did  their 
counterparts  in  the  unlimited  vocabulary  condition. 


Kling,  P.  who  needs  a  person-centered  computer  technology? 

Madison,  Wisconsin:  University  of  Wisconsin,  Department  of 

Computer  Sciences,  Report  No.  WTS-CS-169-73,  1973. 


contemporary  computer  designers  are  largely  machine  centered 
and  emphasize  function  and  standards  of  elegance,  efficiency 
and  computino  power.  The  side  effects  of  systems  way  enhance 
cr  diminish  the  well  being  of  various  users.  Recent  studies 
of  the  human  impacts  of  computing  systems  are  described. 
Person  centered  standards  that  promote  a  sense  of  competence 
and  autonomy  are  outlined.  The  conpling  of  flexible  software 
wi*-h  responsive  organizations  is  suggested  as  a  means  of 
enhancing  personal  competence  and  self-esteem. 
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Knoop,  P,  A.  Advanced  instructional  provisions  and  autoaated 

perforaance  assessment.  Haaan  Factors.  1973,  15,  583-597. 


An  advanced  siaulation  research  systen  is  being  developed  to 
support  evperiaer.ts  oriented  toward  quantifying  ♦■he  effect  on 
transfer  of  training  of  alternative  training  and  siaula^’ior 
techniques.  Included  in  the  systew  is  sophisticated  training 
research  software  which  antowates  aost  of  the  functions 
traditionally  performed  by  flight  siaulator  instructors  or 
operators.  Also  under  developaent  are  techniques  for 
automatically  assessing  pilot  proficiency  in  the  simulator 
and  in  the  operational  aircraft.  Recent  feasibility  studies 
in  performance  measurement  resulted  in  identification  of 
necessary  flight  variables  for  assessing  proficiency  on  two 
undergraduate  pilot  training  maneuvers;  established 
alternative  approaches  to  developing  measurement  techniques 
on  a  broader  scale;  applied  existing  technology  to  develop  an 
in-flight  data  acguisition  system  for  the  T-37  aircraft;  and 
raised  (or,  more  correctly,  reraised)  issues  regarding 
standardization  in  instruction  and  rating  procedures. 


Knoop,  P.  A.  Han-computer  symbiosis  through  interactive  graphics; 
A  survey  and  Identification  of  critical  research  areas. 
Brooks  AFB,  Texas;  Air  Force  Busan  Resources  Laboratory, 
Report  Ro.  AFHBt-TF-77-10,  April,  1977. 


The  ma-jor  distinguishing  featare  of  man-computer  symbiosis  is 
the  capability  of  both  nan  and  computer  to  transceive 
relevant  unregnested  information.  Dsing  this  derived 
definition,  basic  key  require  me  nr s  of  a  symbiotic  system  were 
proiected.  These  included;  (1)  transceivers  and  nesori<>s, 
(2)  graphics  ripchnigues,  (3)  a  language,  and  (4)  an 
attention-getting  capability.  A  literature  survey  revealed 
that  raster  scan  cathode  ray  tubes  hold  the  greatest  promise 
for  use  in  symi'^utic  systems,  but  that  a  critical  problem 
accompanies  their  use  in  that  scan  conversion  methods  are 
required.  Existing  methods  are  either  too  time  consuming  or 
too  memory  consuming.  A  promising  technique  was  found  for 
reducing  the  number  of  vectors  comprising  a  scene.  This 
technique  would  find  its  greatest  utility  in  random  scan 
systems,  where  its  use  may  provide  flicker-free  displays. 
Little  work  has  been  performed  in  extending  man's  memory 
precision  and  recall  capability,  there  are  no  methods  with 
immediate  utility  for  symbiotic  systems  for  efficiently 
removing  hidden  lines  and  surfaces  to  effect  a  3-D  display. 
Fina'*ly,  it  was  determined  that  the  most  promising  solution 
to  the  language  problem  lies  in  the  development  of  hybrid 
communication  tpchnigues  using  a  combination  of  graphic 
languages  and  small  scale  voice  input  methods. 
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Kobrick,  J,  l.  Effects  of  physical  locatior  of  visual  stimnli  on 
intend- ional  r^sporse  time.  Hatick,  nassachuse+ts:  krnv 

Fesearrh  Insfifute  of  Erviroraental  Medicine. 


The  effects  of  physical  location  of  visual  stimuli  on  ♦•he  TP*n 
were  investigated.  Sixteen  subiects  performed  a  simple- 
manual  response  to  flash  stimuli  located  at  32  differen* 
positions  in  the  visual  field.  The  results  indicated  tha-^- 
TPTs  were  unaffected  for  most  lower  visual  hemisphere 
locations.  Significant  decrements  were  only  observed  for 
locations  higher  than  30  degrees  above  the  horizontal  for 
lateral  displacements  greater  than  55  degrees  from  center. 
Ho  significant  decrements  were  observed  even  at  th®  periph-!rv 
for  locations  along  the  horizontal  line  of  sight. 


Lenorovitz,  D.  R.  and  Ramsey,  R.  H.  A  dialogue  simulation  tool 

for  use  in  t^jp  design  of  interactive  computer  systems. 
Proceedings  of  the  Human  Factors  Society.  21st  knnnal 
Meeting,  San  Francisco,  California,  1977. 


A  recurrent  problem  in  designing  interactive  computer  systems 
is  the  inability  of  system  designers,  users,  and  implementors 
to  observe  the  system’s  external  behavior  ur.*il 
implementation  has  occurred.  This,  in  tart,  often  results  in 
failure  to  detect  design  deficiencies  until  a  point  wh»n. 
corrections  are  costly  or  impractical.  A  simulation  tool  is 
described  which  allows  a  systems  desioner  to  interactively 
specify,  implement,  demonstrate,  evaluate,  and  iteratively 
modify  an  operational  simulation  of  the  proposed  system’s 
user-computer  interface.  The  tool  is  intended  for  hands-on 
usage  by  an  aoplications-oriented  systems  designer  with 
little  or  no  formal  training  in  computer  software 
programming.  The  capabilities  and  characteristics  of  the 
tool  are  described  along  with  an  economical  and  effiniont 
approach  to  its  design  and  implementation. 


Le^in,  J.  A.  and  Arcbbold,  A.  A.  Horkirq  papers  in  dialogue 

■odelirq.  Volume  1,  Marina  del  Fey,  California:  Marina  del 
Fey  Information  Sciences  Institute,  Feport  No,  TSI/FR-77-ss, 
January,  1<»77. 


The  five  technical  working  papers  that  compose  this  docum^^n* 
(which  appears  ir  two  volumes)  were  prepared  as  oart  of  th^ 
Dialogue  Modeling  Project  AT  TSI,  Though  diverse  in  scoo®, 
all  are  related  to  the  problem  of  creating  a  valid  process 
model  of  human  communication  in  dialogue.  All  are 
unpublished  and  all  but  one  are  in  a  form  intended  for 
internal  use  by  the  project  team;  however,  they  are  of 
interest  beyond  the  boundaries  of  the  project-  and  have 
implications  for  relatd  work  in  modeling  human  communication. 
In  Volume  I  both  papers  are  or.  reference  as  a  phenomenon  in 
text.  The  first  surveys  reference  identification  and 
resolution  methods  in  various  existing  natural  language 
procesors.  The  other  paper  explores  the  broader  problem  of 
reference,  focusr.g  on  text  reference  and  propositional 
reference.  It  develops  problems  and  proposals  for  defining 
these  categories  of  reference  phenomena  and  for  detecting 
instances  of  them. 
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Levin,  il.  A.  and  Hoor»,  J,  A.  Oialcaue-qames:  Het«-ro«Banica'^ior 
structures  for  natural  lanquaqe  interaction.  Harira  del  ’’ey, 
California:  Marina  del  Key  Irfcrmatlon  Sciences  Institute, 

Peport  No.  ISl/BR-77-53,  vTanuary,  1977. 


Our  studies  of  naturally  occurring  husan  dialogue  have  led  tr 
the  recognition  of  a  new  class  of  regularities  which 
characterize  important  aspects  pf  communication.  Peoole 
appear  to  interact  regularly  according  to  established 
patterns  which  span  several  turns  in  a  dialogue  and  which 
recur  frequently.  These  patterns  appear  to  be  organized 
around  the  goals  which  the  dialogue  serves  for  each 
participant.  Many  things  which  are  said  later  in  a  dialogue 
can  only  he  interpreted  as  pursuit  of  goals  established 
earlier  in  the  dialogue  by  goal-settiTio  parts  of  these 
patterns.  These  patterns  have  been  represented  by  a  set  of 
knowledge  structures  called  Dial ogne-oanes,  capturing  shared 
conventional  knowledge  that  people  have  about  communication 
and  how  it  can  he  used  to  achieve  goals,  A  Dialogue-game  has 
Parameters,  whicii  represent  those  elements  that  vary  across 
instances  of  a  particular  pattern.  The  Parameters  identify 
the  particular  dialogue  participants  and  the  content  topic. 
The  states  of  the  world  which  must  be  in  effect  fer  a 
particular  Dialogue-game  to  be  employed  successfully  ar® 
represented  hy  Specifications  of  these  Parameters,  Finally, 
the  expected  sequence  of  intermediate  states  that  occur 
during  Instances  of  a  particular  conventional  pattern  are 
represented  by  the  Components  of  the  Dialogue-game.  This 
report  describes  a  representation  for  several  Dialogue-games, 
based  on  our  analyses  of  different  kinds  of  naturally 
occurring  dialogue.  A  process  model  is  described,  showing 
Dialogue-game  identification.,  pursuit,  and  termination  as 
part  of  the  comprehension  of  dialogue  utterances.  This 
Dialogue-game  Model  captures  some  cf  the  important  functional 
aspects  of  language,  especially  indirect  uses  to  achieve 
implicit  communication. 
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licklider,  J.  C.  E.  Har-conputer  symbiosis.  jPg  Trarsac^-ions  on 
^gmar  Pactgys  ill  Blectronics.  Barch,  I960,  HZl*37~5-T?7 


Ban-contputpr  symbiosis  is  an  expected  developman^  ir 
coooeratiTe  interaction  between  men  and  electronic  computers. 
It  will  involve  very  close  conplina  between  the  human  and  the 
electronic  members  of  the  partnershlo.  The  main  aims  are  1) 
to  let  computers  facilitate  formulative  thinking  as  th“y  now 
facilitate  the  solution  of  formulated  problems,  and  7)  to 
enable  men  and  computers  to  cooperate  in  making  decisions  and 
controlling  complex  situations  without  inflexible  deoendence 
cn  predetermined  programs.  In  the  anticipated  symbiotic 
partnership,  men  will  set  the  goals,  formulate 
hypotheses,  determine  the  criteria,  and  perform  ^he 
evaluations.  Computing  machines  will  do  the  routinixable 
work  that  must  be  done  to  prepare  the  way  for  insights  and 
decisions  in  technical  and  scientific  tirking.  Preliminary 
analyses  indicate  that  the  symbiotic  partnership  will  perform 
intellectual  operations  much  more  effectively  than  man  alone 
can  perform  them.  Prerequisites  for  the  achievement  of  the 
effective,  cooperative  association  include  developments  in 
computer  time  sharing,  in  memory  components,  in  memory 
organization,  in  programming  languages  and  in  input  and 
output  eguipment. 


Licklider,  J.  C.  R.  Har-computer  partnership.  Science  aad 
•^^chnoloqy.  Hay,  196  6,  18-26. 


Ontil  recently,  efforts  to  conserve  the  valuable  time  of  an 
expensive  computer  precluded  an  interactive  partnership  be¬ 
tween  man  and  high-speed  computino  machine.  But  man  excels 
in  ♦■he  heuristic  phases  of  problem  solving  while  the  computer 
excels  in  executing  explicit  procedures,  on  the  frontiers  of 
research,  heuristic  and  algorithmic  information  processing 
are  not  easily  separated,  but  now  a  human  problem  solver  car 
ask  a  computer  to  explore  his  hunches.  large  computers  are 
generally  needed  to  handle  problem-oriented  languages,  large 
files,  and  complex  problems.  The  computer  cost  is  shared 
amorg  many  users  as  the  machine  rapidly  shares  its  available 
time.  New  kinds  of  displays  and  consoles  enable  man  and 
computer  to  communicate  by  printing  or  writing  or  by  drawino 
pictures  and  symbols.  Special  timesharing  programs  and 
dynamic  displays  are  still  costly.  K  whole  new  community  of 
soph i  stica ted  users  may  produce  results  worthy  of  the 

expense. 
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Haddox,  H.  F. ,  Burnette,  j,  T.,  ard  Gutaann,  J.  C.  Font 

coaparison  for  5x7  dot  aatrix  characters,  Huaap  Factors. 
1977,  19,  89-94. 


Two  newly  designed  fon^s  and  the  tincoln/Hitre  font  a*"* 
compared  for  legibility  using  tarhi stoscopic  presentation  and 
forced  identification.  *11  three  fonts  were  constructed  with 
a  matrix  of  5x7  dots  and  were  presented  with  a  computer- 
generated  display.  The  results  were  analyzed  parametrically 
in  terms  of  total  identification  errors  and  by  conwentional 
confusion  matrices.  The  analysis  showed  significantly  fewer 
errors  with  the  font  utilizing  the  largest  number  of  dots  per 
symbol  than  with  either  of  the  other  two  fonts.  The 
confusion  matrices  revealed  that  the  most  severe  confusions 
cccur  for  different  characters  in  different  fon'^s. 


Banr,  W.  C.  Dialogue-based  research  in  man-machine  communication. 
Los  Angeles,  Califcrnia:  Oniversity  of  Southern  California, 
Marina  Del  Pey  Information  Sciences  Institute,  Peoort  No. 
TSI/PR-75-41 ,  November,  1975. 


This  paper  first  surveys  current  knowledge  of  human 
communication  from  a  point  of  view  which  seeks  to  find  or 
develop  knowledge  that  will  be  useful  to  computer  system 
designers.  The  relevant  scientific  knowledge  Is  found  to  be 
fragmentary  and  hard  for  designers  to  use.  Next,  the  problem 
cf  complexity  is  explored.  Building  a  useful  knowledge  of 
human  communication  is  an  extremely  complex  task. 
Controlling  this  complexity  and  its  effects,  without  giving 
up  usefulness,  is  seen  as  the  central  problem  in  designing  a 
research  aoproach.  Finally,  a  new  research  methodology  is 
presented.  It  contains  some  innovations  that  help  control 
the  complexity  of  the  task,  and  others  that  make  the  results 
useful  to  designers.  The  methodology  is  unique  in  tha*  it  is 
based  on  case  analysis  rather  than  functional  system  design, 
the  results  are  in  the  form  of  individual  computer  algorithms 
<mucf.  smaller  than  systems),  and  the  algorithms  ate 
transferable  into  useful  (nonresearch)  systems. 
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H.  r.  Har-fich ire  coaaurica+j on  research.  Los  Angeles, 
California:  Tir.iversity  of  Sonfhern  California,  Marina  r>®l 
Pey  Tnforaation  Sciences  Tnsri+ufe,  P®por*  No.  rsT/Rp-77-S7, 
February,  1977. 


This  is  the  final  report  of  a  aultifaceted  rasearch  and 
developmen*-  effor*-  in  mar-sachine  coanunications.  Thr 
general  goal  of  the  prograir  is  *-o  facilitate  exis’rirg  and 
future  (iian-aachine  coBBunication  In  areas  of  high  mili«-ary 
iapart,  including  rapidly  expanding  use  of  on-line  computino 
in  coBBunications  and  coeaiand  and  control.  Highlights  of  the 
accoBplishaents  of  rhis  research  include:  identification  of 
Baior  causes  of  aan-Bachine  coamurication  difficulty  for  the 
coaputer-na i ve:  discovery  of  aajer  coBBunication  structures 
in  huaan  coBBunication  that  have  been  left  out  of  man-Bachine 
coBBunication;  creation  of  a  process  Bodel  that  exhibits 
these  structures  in  a  form  which  can  be  ieitated  directly  in 
creating  new  aan-machine  coBBunication s  processes;  creation 
of  a  new  overview  of  hew  human  comaunication  functions  in 
cooperative  task-oriented  activity;  and  assistance  in  APPA 
policy  foraation  or  CAI  eguipaent  development. 


W.  C. ,  Scragg,  G.,  and  Archbold,  A.  A.  Working  papers  in 
dialogue  acdellrg  -  Voloae  2.  Harira  del  Hey,  California: 
Harlna  del  Fey  Information  Sciences  Institute,  Report  No. 
ISI/FR-77-56,  January,  1977. 


The  five  technical  working  papers  that  compose  this  document 
(which  aopears  in  two  volumes)  were  prepared  as  part  of  the 
Dialogue  Hodelirg  Proiect  at  IST,  Though  diverse  in  scooe , 
all  are  related  to  the  problem  of  creating  a  valid  process 
Bodel  of  human  communication  in  dialogue.  All  are 
unpublished  and  all  but  one  are  in  a  form  intended  for 
internal  use  by  the  project  team;  however,  they  are  of 
interest  beyond  the  boundaries  of  the  project  and  have 
implications  for  related  work  in  modeling  human 
communication.  In  volume  2  the  first  uaper  concerns  study 
methodology.  It  raises  some  of  the  following  issues:  how  to 
choose  between  system-building  and  process-building,  why 
studying  cases  is  preferable  to  implementing  general 
language-use  functions  as  programs,  how  to  control  ad-hocness 
cf  results,  why  It  is  important  to  orient  toward 
communication  phenomena  (in  contrast  to  form  phenomena)  when 
studying  natural  language.  The  second  is  a  design  paper  or. 
the  match  process  of  the  Dialogue  Bodel  System,  exploring 
methods  for  making  it  efficient  and  selective  in  i^s  actions. 
The  third  concerns  the  structure  cf  persuasion  dialogues,  in 
particular  how  justification  cf  actions  anpears  ir 
argumer.tation. 


Martin,  J.  O^sian  of  man-computer  dialogues^  Fnqlewood  cliffs. 
New  Jersey:  ^Pr^ntice-Ha lT7~197'57 


This  book  is  based  on  a  coarse  giv<-n  at  the  TBH  Systems 
Research  Institute,  it  deals  with  many  aspects  of  human- 
computer  transactions.  Section  headings  include  the 
following:  alphanomer ic  dialogues,  dialogues  with  sound  and 
graphics,  psychological  considerations  operators  without- 
training,  and  implementation  considerations. 


Martin,  T.  H. ,  Stanford,  h,  c.,  Carlson,  P.  B.,  and  Mann,  ».  c. 

M  policy  assessment  of  priorities  and  functional  needs  for 
the  military  computer-assisted  instruction  terminal.  Marina 
del  Rey,  California;  Marina  del  Rey  information  Scien.r»s 
Institut-G,  Report  No,  lsi/RP-7S-att,  December,  197S. 


A  policy  study  was  conducted  in  four  rounds  to  assess  *-he 
anticipated  payoff  of  an  investment  by  ARPA  in  th® 
development  of  new  terminals  for  use  by  the  military  in 
computer-assisted  and  computer- managed  instruction.  Members 
of  the  panel  of  experts  (11  civilian,  9  military)  proposed 
features,  rated  them,  and  reac«-©d  to  the  resulting  ratings. 
Of  the  24  features,  those  rated  as  most  needed  were  r^en  by 
these  experts  as  likely  to  be  in  commercial  production  five 
to  ten  years  from  now  in  a  form  usable  by  the  military. 
Experts  generally  aareed  that  investments  in  innovative 
pedoqogical  software  and  in  innovative  coursewriting  are 
likely  to  have  a  greater  payoff  than  an  inv«»stment  in 
terminal  development,  of  14  software  features,  those  rat^d 
as  most  needed  are  ones  for  particularizing  instruction 
online  to  the  course-related  needs  of  individual  students. 
The  report  is  a  thorough  description  of  the  conduct  of  the 
St  ud  y . 


Mathieu,  R,  D.  Man-computer  interaction  conference.  London, 

England;  Office  of  Naval  Research,  Report  No.  ONFL-C- 1 1-7 1 , 
July,  1971  , 


Nithin  the  past  few  years  oreat  strides  have  been  made  in 
computer  technology,  in  particular  in  remote-terminal  time¬ 
sharing  facilities  and  computer  languages.  For  thv  first 
time  the  computer  and  its  tremendous  powers  have  b®en  brought 
within  the  reach  of  such  people  as  touchers,  doctors, 
managers,  architects,  designers,  etc.  This  report  describor 
the  procedures  of  the  Man-Computer  Interaction  confe^erc=, 
which  was  held  at  the  National  Physical  T.ahora*cfv, 
Tedd ington ,  UN  or  September  2-4,  1970.  Emphasis  was  placed 
cn  the  computer  use  and  computer  applications. 
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HcCoiBBons,  F.  B. ,  Cook,  T,  C.  ,  ar d  Glunip,  H.  A  roinpa rat ’  ve 

stoi^y  of  sinqle- versus  double-sequence' flata-entry  eethods  for 
use  with  ♦•he  SB-3614/TT  switchboard,  Aberdeen  Provjno 
Ground,  Harvland:  Husan  Pp.qireer?  r.a  laboratory,  Rapor^-  No. 

REL-TB-22-75,  September,  1975. 


Thrae  methods  of  proqramring  ♦•runk-termir.al  assignments  into 
the  electrically  al*-erable  ror-volatile  memory  (FVANvn)  of 
the  SP-361U/TT  switchboard  were  compared.  On®  was  ♦•he 
double-sequence  method  recently  proposed  by  the  SB-3614/TT 
contractor  (GTE  Sylvania,  Meedham  Height,  HA).  The  other  ♦■wo 
were  single-sequence  methods  developed  by  the  authors.  The 
two  slnqle-soquence  methods  used  identical  data  er.*ry 
procedures;  but  with  one,  visual  feedback  was  supplied  tc 
the  tes'*-  subiects  (Ss)  as  an  alphanumeric  display.  Results 
of  this  study  showed  that  both  si nqle-seauence  nethed  wer® 
superior  to  the  double-sequence  method.  In  the  Ss  could 
proqram  faster  and  made  fewer  errors.  Of  the  two  sinolo- 
sequence  methods,  the  one  employira  visual  fea(3hark  arhanred 
Ss  performance,  but,  overall,  ♦■his  enhancement  was  r.o^" 
statistically  significant. 


Hiller,  L,  A,  and  Thomas,  J.  c.,  Jt,  Behavioral  issues  in  the  use 
cf  interactive  systems.  Torktown  Heights,  Hew  york;  IBH 
Thomas  J.  Watson  Research  Center,  Report  Ho,  PC-6325 
(#27179),  necember,  1976. 


This  paper  identifies  bebavioral  issues  related  to  the  use  of 
interactive  computers  primarily  by  persons  who  are  not 
computer  professionals,  so-called  *qeneral  users.*  This  is 
not  an  exhaustive  literature  survey  but  instead  provides: 
(1)  a  structure  for  discussing  issues  of  interactive 
computing,  and  (2)  the  authors*  best  estimate  of  importance 
behavioral  problems,  with  suggestions  for  solutions.  Th® 
discussion  is  limited  to  this  paper  to  oeneral  issues  which 
do  not  take  in^o  account  the  user’s  particular  task.  The  two 
maior  topics  are  System  Characteristics  (performance, 
facilities,  and  on-line  information),  and  Interface 
Characteristics  (dialogue  style,  displays  and  graphics,  other 
input/output  media). 
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Hiller,  P.  P.  Response  ti«e  in  san-ccBpater  conversational 

transactions.  HFIPS  conference  Proceedings.  196P,  31, 

267-277. 


The  literature  corcernirg  ean-cospoter  transactions  abounds 
in  controversy  about  the  li«i«-s  of  "systen  response  tiBe"  ♦■o 
a  user's  cosaand  or  inquiry  at  a  terainal.  Two  eaior 
seuantic  issues  prohibit  resolving  this  controversy.  One 
issue  centers  around  the  question  of  "Response  ti  ■«  to  what?" 
The  iuplication  is  that  different  huuan  purposes  and  actions 
will  have  different  acceptable  or  useful  response  tines. 
This  paper  attempts  a  rather  exhaustive  listing  and 
definition  of  different  classes  of  hnaan  action  and  pnrpcs<> 
at  teruinals  of  various  kinds.  It  will  be  shown  that  "two- 
second  response"  is  not  a  universal  requireuent.  The  second 
semantic  question  is  "What  is  a  need  or  reauireuent ?"  in  the 
present  discussion,  the  reader  is  asked  to  accept  the 
follcwirq  definition:  "k  need  or  requireuent  is  some 
demonstrably  better  alternative  ir  a  set  of  competing  known 
alternatives  that  enable  a  human  purpose  or  action  '■o  he 
implemented."  This  definition  intentionally  ignores  th® 
prohlee  of  value  versus  cost.  It  is  not  offered  as  a 
universally  useful  definition  of  "need."  It  does  enable  us 
to  get  into  a  systematic  exposition  of  problems,  alternatives 
and  implications.  A  value-based  definition,  in  contrast  to 
the  rational  one  given  here,  inevitably  leads  to  a  vicious 
regress  that  dead-ends  only  with  the  agreement  that  all  ♦ha'- 
humans  really  need  are  food,  water,  end  a  place  to  sleep. 
Another  point  of  view,  compatible  with  the  present  one,  is 
that  need  is  equivalent  to  what  is  demanded  and  what  can  be 
made  available;  need,  therefore,  is  a  cultural  and  technical 
outcom®. 


Hiller,  R.  B.  Urchetypps  in  B?»n-coBipatf r  problem  solving. 
Fr gonoaios.  1969,  12  («) ,  S59-?81. 


Information  systemi:  applied  t©  operational  environment’s  have 
meaning  only  ir  what  they  do  for  hamans  performing  tashs, 
whether  clerical,  technical  or  manaoerial.  Each  D®rsor's 
iob-position  ert-ails  irterac-*- ion  with  a  limited  s^t  of 
categories  of  variable  da*:a.  Pv  •limited*  is  meant  less  •■har 
several  thousand,  and  more  lihely  several  hundred, 
categories.  A  category  se*  associated  with  a  collect’tor  of 
t-ashs  p=»rformed  by  an  individual  or  an  organization  may  he 
called  a  category  domain.  This  concept  makes  possible  a 
practicable  (in  size)  data  base  responsive  to  support"  hum.ar 
tasks  in  human  (psycholcgical)  time.  An  analysis  of  human 
problem-solving  tasks  reveals  the  following  gamut-:  simple 

inquiry  and  update,  status  inquiry,  briefing,  exception 
detection,  diagnosis,  planning/choosinq , 

evaluatinq/optimizing,  constructing  (designing),  and 
discovery.  There  is  no  compulsive  ordering  of  these  on  a 
complexity  seal®.  The  informa  ♦‘ion  processing  structure  of 
each  is  examined:  some  common  denominators  among  this  s^t- 
reveal  fiv®  underlying  archetypes  of  interaction.  By  makina 
these  archetypes  explicit-  and  consistent  with  concepts  ot 
domain,  apnlicat-ion  disciplines  and  system  design  can  mov**  in 

parallel  and  generate  a  simple,  well-defined  lanauage 
structure  between,  system  and  human  user. 


mills,  R.  G.  nan-coBputGr  interaction-present  and  future,  lERR 
Internationa,},  Convention  Record .  1966,  14,  196-198, 


The  potential  of  the  large-scale  computer  system  is  greatly 
enhanc'^d  by  the  addition  of  man-machine  interaction  using 
aporopriate  terminal  devices  and  languages.  In  fact,  the 
man-machine  coupling  problem  in  its  full  breadth  is  the 
central  issue  in  advancing  interactive-computer  technoloav. 
Some  possible  future  directions  are  indicated. 


HJ11.S,  P.  G.  Han-machine  communication  and  problem  solvino. 

Annual  Review  of  Information  Science  and  Technology ,  1967,  2, 

22  3-2Stt7 


This  chap-'-er  begins  wi+h  a  brief  statement  of  the  basic 
approach  and  tl«=  criteria  used  in  selecting  the  material  t-o 
he  cited.  A  summary  of  the  principal  source.?  follows;  this 
is  followad  by  t-vp  main  body  of  *-he  review.  The  rat-her 
lengt-hy  conclusion  attempts  to  place  the  1966  st-at-p  ©f 
affairs  perspect-ive,  !♦•  is  a  reference  frame  and  stat-us 
summary,  but  also  an  implicit-  statement  of  the  r“view*r*s 
viewpoint . 


Bin^-on,  o.  Inspection  and  correction  error  in  data  processinq. 

Aaerican  Statistical  Association  Joornal.  1969,  ^  (329) , 

1256-1275. 


It  is  coavon  practice  ♦•o  assnne  ^hat  inspectors  of  sanple 
iteas  and  correctors  of  iteas  in  reiected  worit  lots  carry  on* 
their  iob  without  error  and  invariably  classify  defective*? 
and  nordefectives  correctly.  This  assoaption  does  not  aqree 
with  experience  in  data  processinq  activities,  especially 
those  requirinq  interpretation  and  iudqaent  as  well  as 
clerical  or  aachine  skills.  This  paper  eaphasites  the  error 
of  classifyinq  defectives  as  nondefectives  (Typell)  aade  by 
inspectors  called  "verifiers"  and  by  correctors  to  prepare 
data  for  machine  readability.  The  following  ar^-ivities  are 
included  (1)  verification  of  card  punching,  (2)  proofreading 
of  typed  data,  (3)  verification  of  codes  clerically  assigned 
to  written  responses  or.  questicnnaires,  (4)  matching  of  codas 
assigned  independently  by  three  coders  to  the  sane  item,  and 
(5)  proofreading  of  the  output  of  special  typing  combined 
with  coding  and  rounding  Hqures  for  input  to  optical 
scanning. 


Boore,  J.  A.,  Levin,  J.  A.,  and  Bann,  W.  C. ,  A  goal-oriented  model 
of  natural  language  interaction.  Barina  del  Rey,  California: 
Barina  del  Rey  Information  Sciences  institute,  Repor*-  No. 
ISI/PR-77-52,  January,  1977. 


This  report  summarizes  a  research  program  in  modeling  human 
communicative  ability.  The  methodoloqy  involved  selecting  a 
single,  naturally-occurring  dialogue,  instructng  a  human 
cbserver  to  extract  certain  aspects  of  the  dialogue  relating 
to  its  comprehension,  and  then  using  these  aspects  to  guide 
the  model  building  and  verification  activity.  Behind  the 
model  is  the  development  of  an  innovative  theory  of  lanquaae, 
according  to  which  people  engage  in  language  behavior  in 
order  to  pursue  their  own  qoals.  Dialogues  communica'^e 
effectively  because  of  a  shared  understanding  of  a  collection 
of  interrelated,  cooperative  qoal  structures,  held  and 
pursued  by  the  language  users.  The  recognition  of  this 
shared  knowledge  within  the  mod®l  contributed  to  an  Initial 
accounting  of  implicit  commur ica tier. .  The  report  contains  a 
detailed  statement  of  the  problems,  a  review  of  the  s^a^’e  of 
related  research,  a  description  of  the  contributions  of  ^his 
research  to  linguistic  theory  and  an  explanation  of  the 
research  methodology.  It  then  describes  the  model  in  i^s 
current  state  of  development  end  discusses  a  detailed 
simula^-ion  of  it.  next  the  role  of  the  observer  in  ♦■he 
research  is  explored  with  emphasis  on  the  nature  of  his  task. 


■ipWLiiii.iyi 

-  4.  - - 


Horfield,  H.  A.,  Wiespn,  R,  A.,  Grossberq,  N,,  and  Ynteaa,  D.  F. 

Initial  experiments  on  the  effects  of  system  delay  on  on-line 
problem  sol vino.  Cambridge,  Massachusetts:  Hassachuse^-s 
Institute  of  Technology,  Lexington  Lincoln  Laboratory,  Repor*- 
So.  TR-1969-5,  June,  1969. 


Three  experiments  explored  the  way  in  which  delay  in  th«= 
response?  of  the  system  affects  the  user's  performance  in 
solving  problems  with  an  on-line  computing  service.  In  each 
experiment  there  were  four  sobiects  under  delay  conditions  of 
about  1  sec.  to  100  sec.  The  on-line  computing  service  was 
the  Lincoln  Pepkoner.  As  expected,  the  average  time  the  user 
reguiried  to  complete  a  task  increased  as  the  response-dela v 
increasc-d,  and  the  rate  at  which  he  demanded  service  declined 
as  the  delay  increased.  The  relation  of  net  completion  '•ime 
(time  ♦•o  complete  the  task,  minus  the  tine  during  which  the 
user  was  waiting  for  a  response)  to  response  delay  deoended 
on  the  type  of  task.  In  the  more  realistic  experiments,  the 
net  completion  time  increased  with  delay  (suggesting  tha*- 
Iona  delays  are  distracting).  The  number  of  outputs  (i.e., 
displays  or  type-outs)  per  task  was  also  considered.  The 
main  conclusion  is  that  controlled  experiments  of  this  kind 
are  feasible  and  can  be  used  as  the  basis  for  design  of  on¬ 
line  computing  services. 


Horrill,  C.  S.  computer-aided  instruction  as  part  of  a  management 
information  system.  Human  Factors,  1967,  9,  251-2‘>6. 


This  paper  discusses  the  application  of  computer-aid-^d 
instruction  as  part  of  a  management  information  system.  The 
computer  presents  displays  which  instruct  the  student  on-line 
to  exercise  control  of  the  computer  system  using  a  typewri'-er 
or  a  lightpen  located  at  the  console  work  station. 
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nuckler,  F,  A,  and  Obprnayer,  R.  M.  Inforvaticn  display.  Inter¬ 
na  ti onal  Ssipnce  and  Technology.  August,  196S,  4U,  34-40. 


Displays  are  intend'^d  tc  provide  a  human  operator  with  the 
kind  of  information  that  he  can  transform  into  useful 
decisions  or  control  actions,  while  the  technology  exists  to 
present  qualitative,  quantitative,  symbolic,  and  pictorial 
data,  it  is  not  always  certain  how  fhese  forms  ar^  best  used 
to  assure  that  the  human  receiver  is  getting  clear, 
unamhiauous  information  that  can  lead  to  the  desired  output 
of  the  total  man-machine  system.  Han  is  a  unigue  information 
processor  because  he  gives  meaning  to  information.  But  his 
processing  ability  is  limited  by  data  load  and  speed  stresses 
to  which  he  adapts  remarkably  in  ways  that  are  not  fully 
understood.  The  context  in  which  information  has  value  is  in 
a  man's  head.  This  context  is  in  a  machine  only  to  the 
degree  that  some  human  has  put  it  there  as  prior  contextual 
rules  of  how  a  system  should  operate.  Combining  several 
types  of  data  on  one  display  indicator  does  not  assure  the 
infegration  of  information,  which  really  occurs  in  the 
context  of  man's  interpretation  of  the  display.  Host  display 
design  has  suffered  from  a  pre-occupation  with  hardware, 
rather  than  developing  better  communication  with  man. 


Harvrccki,  L.  H,,  Strub,  H,  H, ,  and  Cecil,  P.  H.  Error 

categorization  and  analysis  in  man-computer  communication 
systems.  IEt}E  Traagactiong  o£  Reiiabilitir,  1973,  R-22, 

135-139. 


This  paper  briefly  examines  traditional  approaches  fo  human 
reliability  and  presents  a  technique  which  permits  the  system 
designer  to  derive  a  mutually  exclusive  and  exhaustive  spf  of 
operator  error  categories  in  a  man-compufer  system.  These 
error  categories  are  defined  in  terms  of  process  failures  and 
provide  the  system  designer  with  a  qualitative  index  suitable 
for  determining  error  causes  and  conseouences.  The  technique 
is  demonstrated,  and  the  utility  of  the  resulting  error 

categories  is  evaluated  in  the  cor+ext  of  two  studies  on  a 
military  information  processing  systom.  The  paper  concludes 
with  a  brief  discussion  of  detectable  and  non-detectahle 
errors  and  a  suggestion  for  determining  the  impact  of  errors 
cn  ultimate  sys'-em  goals. 
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llechf>s,  P.  Tn^elliqert  ‘Educational  dialoqo^  systeas.  San  Dieqo, 
California:  nniuarsity  of  California,  San  Dingo  La  Jolla 

center  for  Hnaar  Inforaation  Processing,  Report  lio,  7701, 
March,  1977. 


This  paper  describes  a  hypothetical  coaputer  prograa  capable 
of  naulating  th®  behavior  of  a  human  tutor.  Such  a  prograa 
aus^  ideally,  display  a  number  of  characteristics.  It  must 
be  mixed-initiative,  aeaning  that  either  student  or  tutor  aay 
initiate  an  interaction.  It  aust  be  capable  of  understandino 
natural  language  input  and  oenerating  natural  language 
output.  It  must  be  highly  knowledgeable  about  its  subject 
aatter,  and  generative  in  order  to  be  able  to  answer 
unanticipated  goestions.  Finally,  the  systea  aust  be 
flexible  enough  to  detect  the  needs  of  a  student  and  alter 
its  E-eaching  strategy  sc  as  to  best  meet  those  needs.  The 
first  part  of  the  paper  discusses  what  the  major  parts  of  the 
system  would  be,  the  functions  each  part  would  carry  ou^-,  and 
the  means  by  which  they  interact.  The  goal  is  to  develop  a 
general  system  that  Can  be  nsed  with  a  number  of  different 
teaching  strategies.  The  second  part  of  ■►he  paper  analyzes 
the  socratic  teaching  method  in  order  to  determine  the 
reguirements  for  implementation  within  the  system. 


iickerson,  P,  S.  dan -computer  interaction:  k  challenge  for 

human  factors  research.  Ergonomics,  1969,  12  (h) ,  501-517. 


This  paper  claims  that  the  increasing  heterogeneity  of  the 
community  of  computer  users  poses  a  challenge  to 
psychologists  and  human  factos  researchers.  There  follows  a 
brief  discussion  of  why  this  challenge  apparently  has  not  y«t 
evoked  a  strong  response.  Three  problems,  or  problem  areas, 
are  identified  as  beirg  particularly  in  need  of  human  factors 
research.  These  are  (1)  the  development  and  evaluation  of 
conversational  languages,  (2)  the  determination  of  how  the 
use  patterns  adopted  by  users  depend  on  system 
characteristics,  and  (3)  the  description,  or  modeling,  of 
man-computer  interaction. 
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Nidcerson,  P.  S.,  Elkina,  J,  I,,  and  Carborpll,  J.  P.  Humar 

factors  and  thfi  d^siqn  of  time  sharina  compntor  systems. 

Susat  lasiars,  i968,  io,  127-134. 


The  advent-  of  rompoter  tim®  sharing  poses  an  extraord ira ’^v 
challenge  to  humar  factors  research  during  the  nex*-  decade. 
Before  time  sharing,  two  facts  combined  to  de-emphasixe  •^h® 
importance  of  human  factors  considerations  in  the  desiqn  of 
computer  systems:  (1)  the  cost  cf  the  computer's  time  was 
exorbitantly  high  relative  to  the  cost  of  users'  time,  and 
(2)  the  users  constituted  a  select,  highly  skilled  and  hiahly 
motivated  group  of  specialists.  Two  of  the  promises  of  tim® 
sharino,  however,  are  (1)  a  drastic  reduction  in  the  cost  of 
computer  time  to  the  individual  user,  and  (2)  the  large  seal® 
availability  of  computer  facilities  tc  individuals  untrained 
in  any  areas  of  compu+er  technology.  Human  factors 
considerations  then  become  important  both  for  economic  and 
psychological  reasons.  This  paper  briefly  notes  wha'-  a  few 
cf  these  considerations  are. 


Obermayer,  P.  H,  Accuracy  and  timeliness  in  large-scale 

data-entry  subsystems:  Proceed  j.nqs  of  the  21,st  annual 

meeting  of  the  Human  Factors  Soci  etv.  Santa  Mor.ica7 
California,  Human  Factors  Society,  October,  1977. 


Errors  generated  at  the  input  to  automated  information 
systems  threaten  the  utility  of  the  outputs  produced  by  such 
systems--! . e. ,  the  classic  GIGO  (Garbage  In--Garbaqe  Out) 
problem.  Large  amounts  of  effort  and  attendant  cos^-s  ate 
involved  in  dealing  with  these  errors  once  they  are  in  the 
system;  however,  more  attention  should  be  given  to  a 
coordinated  solution  of  the  problem  at  the  source--  the  data 
entry  point.  A  large-scale  data-entry  subsystem  model  is 
presented,  together  with  statistics  or  error  and  timeliness. 
The  concept  of  a  Source  Data  Entry  Module  (SDEH)  is  presented 
along  with  considerations  of  desian  criteria  and  a  design 
approach.  An  example  is  given,  paralleling  a  testhed  for 
which  data  collection  is  planned.  It  is  suggested  that  a 
generalized  SDFM  design  may  be  achieveable,  providing  a  basis 
for  the  solution  of  a  wide  range  of  automated  information 
system  data  entry  problems. 


Palae,  .7,  interactive  software  for  hueans.  Stockhola,  Sweden: 
Research  Institute  of  National  refense,  Repor*  No. 
Cl0029-n3  (BS)  ,  July,  197*i, 


Nhich  of  the  human  needs  tha*  are  affected  hy  th®  use  of 
computers?  How  will  computers  affect  the  humans  usinq  them? 
Hhat  kinds  of  communications  between  humans  will  the 
computers  cause?  How  can  computer  systems  be  desiqned  to 
better  satisfy  human  needs?  Hhat  design  principles  should  be 
used  for  such  systems?  Hhat  kinds  of  man-machine  interaction 
will  better  satisfy  human  needs?  This  paper  discusses  these 
problems  and  presents  various  methods.  Computer  driven, 
command  driven  and  natural  lanquaqe  interaction  is  discussed. 


Parsons,  H.  n.  The  scope  of  human  factors  in  coapoter-based  data 
processing  systems.  Human  Factors.  1970,  22,  165-17S, 


Hork  ir.  human  factors  encompasses  r<=^search  and  application  in 
human  engineering,  procedure  development,  training 

techniques,  personnel  requirements,  test  and  evaluation,  task 
description,  and  task  allocation.  Opportunities  and  needs 
exist  in  computer-based  data  processing  systems  for  all  these 
endeavors,  especially  with  regard  to  on-line  users.  Hithin 
human  engineering,  only  manual  entry  has  so  far  received  much 
research  attention.  Hork  is  also  needed  on  displavs, 

integrated  entry-display,  workspace  and  other  equipment 
aspects,  on-line  languages,  and  program  prodac*ion.  of 
greatest  concert  to  human  engineeriro  is  the  computer  output 
designed  by  programmers,  rather  than  the  hardware,  Ruma 
factors  people  will  have  to  master  a  new  field  and  provide 
guidance  to  a  n«w  discipline  which  has  not  yet  understood 
human  factors  requirements. 


^  a 


Paalscn,  B.  c. ,  Jr,  Cortinuirq  tp^search  ir.  the  developnent  of 

interactive  nan-coenater  systeas  for  enqineerinq-const ruction 
prelects.  Stanford,  California;  Stanford  Tlniversi^y, 
Departaent  of  Civil  Enqineerirq,  Report  Ho.  "‘R-200, 
Septeahor,  1975. 


This  report  describes  research  eaployinq  an  interactive  aan- 
coaputer  ervironaent  to  develop,  iapleaent  and  test 
hypotheses  and  systeas  involvinq  integrated  network  acdels 
for  the  planning  and  control  of  resources  and  operations  on 
large  engineering-construction  proiects.  Such  analytical 
systeas  and  procedures  are  urgently  needed  for  planning  and 
controlling  increasingly  large  and  coaplex  engineering  and 
construction  progects.  Bxaaples  include  rapid  transit 
systeas,  nuclear  power  plants,  and  airing  developments. 
Specific  objectives  included;  (a)  Continue  development  of 
promising  analytical  algorithms  and  procedures.  (b) 
Implement  systems  and  hardware  for  communications  at  th®  man- 
computer  interface  to  integrate  the  project  engineers* 
experience,  judgment  and  qualitative  analysis  direc*-lv  into 
the  problem-solving  process,  (c)  fliriaize  the  fe®dbacle  tin® 
required  to  get  information  to  decision  makers  for  control 
purposes,  (d)  Develop  objective  means  to  evaluate 
alternatives  In  planning  and  control  subsystems. 


Peace,  D.  H.  S.  and  Easterby,  R.  S.  The  evaluation  of  user 

interaction  with  computer-based  management  information 
systems.  Human  Factors.  1973,  JS,  163-177, 


The  paucity  of  human  factors  work  in  computer  system  design 
is  noted,  and  reasons  for  this  are  elaborated  with  par*-icular 
reference  to  computer-based  management  information  systems. 
The  main  obstacle  to  such  buisar  factors  endeavor  would  appear 
to  be  th®  lack  of  appropriate  investigatory  techniques.  To 
remedy  this  deficiency  a  method  is  proposed  which  derived 
from  the  field  o^  psychotherapy.  Pilc^  studies  are  r®ported 
which  deaonstra*-e  the  technique  and  indira*"®  how  the  data 
obtain®d  may  be  ir*-erpreted,  Hn  appraisal  of  the  pot®rnial 
cf  this  ♦echnique  in  the  management  information  system  field 
is  presented. 
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Pew,  P.  i.,  Pollir.s,  A.  n. ,  and  Villiaas,  G.  A.  Generic 

■an-cofputer  dialoque  specification:  An  alternative  ♦•c 
dialoque  specialists.  Proceedings  of  the  Internationa ^ 
Frqonoaics  Association.  6th  Arr.nal  Congress,  college  Park, 
Harp  rand,  JalyT  1^o7”261-254. 


It  has  long  been  argued  that  nan-coapu^-er  dialogues  should  he 
writ'^er  by  user-orientefl  hnaan  factors  specialists  rather 
than  by  systems  designers  who  were  once  programmers  and  who 
tend  to  think  like  programmers.  The  difficul«:y  is  that  very 
few  human  factors  specialists  have  access  to  the  dens  of 
systems  designers  and  even  when  their  usefulness  is 
recognized  there  are  not  enough  such  specialists  to  meet  ‘•hi^ 
need.  This  paper  will  report  on  an  alternative  procedure  in 
which  the  human  fac^-ors  input  is  made  at  the  stage  at  which 
system  planning  is  under  way,  when  system  characteristics  are 
sufficiently  well  defined  that  i*-  is  possible  *-o  write  a 
dialoque  specification,  bu*-  before  systems  designers  have 
begun  to  write  dialogues.  If  this  specifica^’i  on  is 
effective,  it  will  give  the  designer  freedom  to  do  what  he 
does  best,  but  will  do  it  within  predefined  constraints  that 
will  promote  the  development  of  an  effective  interactiv*' 
system.  In  corgunction  with  the  development  of  a  large-scale 
system  proposed  by  the  Agricultural  Stabilization  and 
Conservation  Service  such  a  set  of  dialogue  specifications 
was  written.  The  specifications  would  permit  several  system 
design  teams  to  work  independently,  but  produc®  dialogue 
that  is  relatively  uniform  from  subsystem  t  •  subsystem  and 
that  moots  standards  for  good  human  factors  design,  '^he 
steps  undertaken  to  create  the  specif leaf ion  are  aescrihed 
together  with  solected  samples  of  the  kind  of  dialogue  that 
may  result , 


A-53 


Press,  L.  Toward  balanced  aan-aachine  systeas,  In^pmational 
JQMrnal  waaTWacMne  studies.  1971,  3,  fil-TTT 


This  paper  begins  with  a  sieple  classif icaticr  schee®  for 
■an'Pachine  systeas  in  which  the  question  used  for 
classification  is:  Shich  partner  is  gieirg  instructions  and 
which  one  is  executing  thea?  A  brief  survey  of  current 
systems  and  dewelopaent  work  shows  that  little  is  being  done 
with  "balanced"  systeas,  that  is  those  where  both  partners 
are  ac*-iye,  where  either  aay  sogaest  operations  or  e»^»cute 
them,  and  where  the  order  of  the  steps  in  the  problsm-solying 
process  is  lointly  deterained.  One  strategy  for  develooinq  a 
balanced  systea  is  to  extend  a  aachine-only  systea  to  allow 
for  interaction  with  and  participation  by  a  nan,  who  must  be 
enabled  to  input  decisions  and  to  request  inforaation  to  help 
hia  aaVe  those  decisions.  This  strategy  is  useful  for 
probleas  which  car.  be  autoaated,  but  where  all  of  the 
inforaation  known  to  the  investigator  carnot  be  represented 
explicitly  or  where  routines  to  process  it  econoaically 
canrot  be  invented.  Examples  are  given  of  the  potential 
apoliratiop  of  the  approach  to  siaulation  studies. 


Purdue  Laboratory  for  Applied  Industrial  Control,  Significant 

accoaplish ments  and  documentation  of  the  International  Purdue 
Workshop  on  Computer  Systeas,  Part  Til.  Development  of 
interfaces  and  data  transmission,  in  raan-aachine 
communications  and  in  the  safety  and  security  of  industrial 
computer  systems,  Lafayette,  Indiana:  Purdue  Oniversity, 
labora'^orY  for  Applied  industrial  Control,  January,  1977, 


This  volume  represents  Part  .3  of  a  six  volume  set  reproducina 
the  ma-jor  work  accomplished  by  the  International  Purdue 
Workshop  on  Industrial  Computer  Systems  during  the  past  eight 
years.  This  material  is  reprinted  from  the  ninutes  of  ‘he 
several  individual  meetings  of  the  workshop  and  represen’-s 
the  work  carried  out  by  the  standing  committees  of  the 
Workshop. 


P«rdo€  Laboratory  for  Ilppli«»d  Industrial  Control,  sianificant 

accoaplisbat^nts  and  docuaentation  of  th**  Tntornatioral  Purdup 
Vorkshop  on  Industrial  Coapotor  Syst^as.  Part  ?T . 
Guidelines  for  the  design  of  aan/aachine  interfaces  for 
process  control.  Lafayette,  Indiana;  Purdue  Oniaersity, 
Laboratory  for  Applied  Industrial  control,  January,  1977. 


This  Tcluae  represents  Part  6  of  a  six  aoluae  set  reproducino 
the  aaior  work  accoaplished  by  the  International  Purdue 
Workshop  on  Industrial  Coaputer  Systeas  during  the  past  eight 
years.  This  aaterial  is  reprinted  froa  the  Binutes  of  the 
Workshop  and  represents  soae  of  the  work  carried  out  by  the 
f!an/*iachine  Coaaunications  coanittee  of  the  Workshop. 


Panspv,  P.  H.  ,  Atwooi,  W.  F.,  and  Van  Dorpr,  J.  R.  A  coaparativ'? 
study  of  flowcharts  and  urogram  design  languages  for 
de^-ail-^d  procedural  specification  of  computer  urograms. 
Alexandria,  Virginia:  a.  S.  Armv  Pesearch  Institute  for  ♦•h® 
Behavioral  and  Social  Sciences,  Army  Research  Insritiii-p 
Technical  Paper,  in  press. 


This  experimental  study  was  performed  in  an  attempt  to  ass«=ss 
the  relative  merits  of  Program  Design  Languages  (POLs)  and 
flowcharts  as  techniques  for  the  development  and 
documentation  of  detailed  designs  for  computer  programs. 
Twenty  students  in  a  computer  science  graduate  course 
participated  ir  an  experiment.  Working  individually,  t^e 
studer.*:s  d€siqr.°d  a  two-pass  assembler  for  a  simple 

minicomputer.  Half  the  students  expressed  their  design  for 
the  first  pass  cf  *he  assembler  in  the  form  of  a  flowchart, 
and  expressed  their  design  for  *he  second  pass  ir  a  Program 
Design  Language.  The  other  half  of  the  students  used  a  mi 
for  pass  one,  and  a  flowchart  for  pass  two.  Flowcharts  and 
POT  s  wore  cotnoarod  on  th=>  basis  of  various  measures  of 
ovorall  design  quality,  design  errors,  lovel  of  detail  ot 
designs,  time  expended  in  developing  designs,  and  sub-jective 
preferences.  Having  completed  this  design  task,  the  suhiocts 
then  performed  an.  implementation  t^gi^.  They  wer®  given 
fairly  detailed  procedural  designs  for  a  program  which 
sifflulafos  the  function  of  a  fairly  sophisticated 

minicomputer.  They  were  then  required  to  develop  a  working 
version  of  the  program  in  PL/1.  Although  the  designs  were 
logically  equivalent,  half  the  students  received  their 
simulator  design  in.  flowchart  form,  and  half  in  POL  form. 
Flowcharts  and  POLs  were  compared  or  the  basis  of  design 
comprehension  test  oerformance,  various  measures  of  overall 
impiementation  quality,  implementation  errors,  and  subiectiyc* 
preference.  In  the  context  in  which  this  study  was 
performed,  the  use  of  a  Program  Design  Language  (POL)  by  a 
software  designer,  for  the  development  and  description  of  a 
detailed  program  design,  produced  better  results  than  did 
use  of  flowcharts.  Specifically,  the  designs  appeared  to  be 
cf  ciqnif icar.tlv  better  auali^y,  involving  more  algorithmic 
or  procedural  de+’ail,  than  those  produced  using  flowcharts. 
In  addition,  flowchart  designs  exhibited  considerably  more 
abbreviation  and  other  space-saving  prartice.s  than  did  POL 
designs,  with  a  possible  adverse  effect  on  their  readability. 
When  equivalent,  highly  readable  designs  were  present?^  to 
subiec*s  in  both  PDL  and  flowchart  form,  no  pattern  of  short¬ 
term  or  long-term  differences  in  comprehension  of  the  design 
was  observed.  No  significant  differences  were  deteetpf^  ir 
th®  quality  or  other  properties  of  programs  written  as 
implementations  of  the  designs.  Subiective  ratings  indicated 
a  mild  preference  for  POLs.  Overall,  ^he  results  sugg^s* 
that  software  design  performance  and  designer-programmer 
communication  might  be  significantly  improved  by  the  adoption 
of  informal  Program  Design  Languages,  rather  than  flowcharts. 


as  a  standard  documentation  method  for  detailed  compu^-er 
proqra*  designs. 


Reisrer,  P.  Ose  of  psychological  experinputation  as  an  aid  ♦•o 

development  of  a  query  language.  TREP  Transactions  on 
Spft ware  Engineering.  1977,  gB-3  (3) ,  2T5-?2  9T 


This  paper  describes  a  series  of  psychological  exoerimerts 
used  to  test  a  nev  data  base  query  language.  Th^  intent  is 
to  make  psychological  ♦esting  of  a  language  part  of  ■’•he 
design  and  development  process.  By  testing  a  language  whil*- 
it  is  still  under  development,  features  that  require  chanqina 
can  he  identified  and  the  changes  made.  The  experiments, 
which  used  college  students  as  subiects,  investigated:  1) 
overall  "learnabiiity"  of  the  language,  7)  "learnabilit v"  of 
individual  features  of  the  language,  and  3)  the  types  and 
frequencies  of  errors  made.  Recommended  changes  to  the 
particular  language  and  the  basis  for  those  recommendations 
are  described.  In  addition,  errors  made  by  experimental 
sub-fects  during  the  testing  are  then  analvzed  from  the  point 
of  view  of  possible  causes.  Based  or  this  analysis,  a 
preliminary  model  of  query  writino  and  two  possible  indices 
cf  query  complexity  are  suggested. 


Riinsdorp,  J.  E.  and  Pouse,  H.  B.  Design  of  man-machine 

interfaces  in  process  control.  In  Van  Nauta  Lemke  (Pd.) 

£2fi£iIiS£  afiElisaliaHS  12  process  control.  New  Tcrk: 
TPIC  and  Borth-Holland  Publishing  Company »  1977,  705-720. 


computerized  CRT-displys  are  rapidly  being  introduced  into 
man-machine  Interfaces  for  process  control  and  supervision. 
The  flexibility  of  these  devices  can  promot*'  the 
incorporation  of  human  factors  in  interface  design.  This 
paper  gives  a  survey  of  design  criteria  and  guidelines  for 
Allocating  system  functions  "man."  and  "machine" 

coping  with  operator  skills;  evaluating  CRT-displays  an 
choosing  controls  and  dialogue  structures  for  CPT- 

di splays  type  of  displays.  Also,  attention  is  paid  to 
experimental  comparison  of  design  alternatives,  and  to  the 
influences  of  the  human  organization,  high  mental  stress  and 
•Job  satisfaction  on  interface  design. 
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Qi  «•  ** 


Pina®l,  S.,  Vicino,  F.  l.,  and  Andrews,  P.  S.  Human  factors 

research  in  compand  information  procpssira  systems, 
iashinqton,  P.  C.:  Army  Personnel  Pesearch  Office,  Pep'^rt 
No.  APPO-TPR-1145,  March,  1966. 


The  report  describes  the  scope,  rationale,  organization,  end 
progress  of  a  command  systems  research  proarair  to  provide 
human  factors  information  needed  fer  performance  with?  n 
complex  automated  information  pepcessinq  systons.  Followina 
a  survey  of  military  information  processing  equipment-  and 
operations  and  future  plans  for  command  information 
processing  systems,  basic  human  factors  problems  wore 
identified  and  organized  around  five  critical 

operations--screenir.q  incoming  data,  •‘ransforminq  raw  data 
for  input  into  storage  devices,  input,  assimilation  of 
displayed  information,  and  decision  making.  A  research 
program  was  formulated  and  studies  undertaken  to  yield 
empirical  information  about  the  effects  on  human  performance 
of  (1)  characteristics  of  the  information  presented  (density, 
amount,  etc.);  (2)  dynamic  aspeers  of  information  (^voo, 
extent,  coding  of  updates);  (:i)  display  modes  and  sansorv 
modalities  (group  vs  individual  displays,  multisarsory 
displays) ;  and  (4)  computer  aids  tc  the  decision  process.  A 
Command  Systems  Laboratory  was  developed  to  permit  simulation 
cf  various  TOS  functions.  Findings  have  sugges'^.ed  ♦he 

possibility  of  reduction  in  stcjBqc  capacity  require mer^s, 
number  of  displays  called  from  storage  during  a  given 
operational  time  period,  and  time  required  for  the  total 
information  assimilation-decision  process  and  simported  th^ 
incorporation  and  use  of  information  consDicui*-y  coding 

capabilities  in  command  systems. 


Root,  R.  T.  and  Sadacca,  R,  Man-computer  communication 

technioues;  Two  experiments,  Hum^  Factors,  1967,  9, 

f21-52fl.  “ 


Two  experimental  studies  are  reported  that  were  intended  *■  o 
evaluate  man-romputer  communication  techniques  within  the 
context  of  the  cemputer-based  image  interpretation  facility. 
The  first  experiment,  comparing  five  different  data  entry 
procedures,  indicated  that,  although  a  procedure  requiring 
the  interpreter  to  enter  report  data  directly  usng  a  t«letvDc 
)reyboard  resulted  in  the  shortest  overall  throughput  tim®,  a 
proceduro  involving  message  composition  by  the  imag«^ 
interpreter  with  subsequent  transcription  by  a  communicator 
minimizes  the  tino  spent  by  the  interpreter  in  report 
generation  and  maximixes  the  tim®  available  for  the  detection 
and  Identification  cf  targets  on  aerial  Imagery.  The  second 
experiment,  evaluating  alternative  word  form-data  en*Ty 
format  combination,  showed  no  differences  among  th®  sir 
combinations  studied. 
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Roscoe,  S.  K.  Airborne  displays  for  flight  and  navioatien.  Husar 
Fact  ops,  1968,  JO,  321-332. 


This  paper  deals  with  certain  types  of  airborne  displays, 
specifically,  those  used  in  naviqatina  and  flying  aircraf*-. 
Consideration  is  ai»en  to  the  nature  of  the  crew*s  flight 
task,  to  certain  principles  of  flight  display,  and  to  some  of 
the  experimental  evidence  bearing  on  principles  of  display. 


Poscoe,  S.  N.  Assessment  of  pilotage  error  in  airborne  area 

navigation  procedares.  Homan  Factors.  1974,  16,  223-228. 


In  1969,  by  specifically  including  "pilotage  error"  in  he 
error  budget  for  area  navigation  system  certif icaton,  th® 
Federal  Aviation  Administration  legally  attached  economic 
premiums  and  "penalties  to"  human,  as  well  as  equipment, 
performance  in  mar-machine  system  design.  To  establish  the 
accuracy  of  use  and  freedom  from  pilot  blunders  associat<»d 
with  systems  employing  various  configurations  of  displays  and 
controls  requires  both  simulator  and  flight  experimentation . 
An  automatically  adaptive  cockpit  side  task  provides  a 
saturating  level  ot  pilot  workload  and  allows  th"*  sensitive, 
orderly,  and  statistically  reliable  measurement  of  a  pilot's 
residual  attention  as  a  common  metric  for  area  navigation 
system  assessment. 
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Poscof-,  S.  N.  and  Eis<^lo,  J.  F.  <;qrat<»d  corapn ter-qen "“ra ^od 

cockpit:  displays.  Tr  T.  B.  Sh<aridar  and  R.  Johnson  (Eds.) 
Honi^orinq  behavior  and  suoervlsorrv  control .  York: 

Plenua  Press,  1976,  39-SO. 


In  the  new  generation  of  hinh-soeed,  aulri-aission  aircraft 
the  role  of  the  pilot  has  charged  substantially.  Mow  <5ycr*-=in 
elements  typically  require  the  man  to  be  an  information 
manager  or  a  fas*-  decision  maker  as  opposed  to  a  dir^c* 
controller  of  flight  variables.  Adjustment  to  the  n“w 
demands  has  been  greatly  assisted  by  innovations  in  display 
and  control  technology  and  the  inclusion  of  advanc-xl 

computers  on  hoard.  These  innovations  have  increased  the 
degree  of  freedcni  in  function  allocation  and  display  and 
control  system  design,  to  capitalize  on  ♦•hcsc. 

cpportunities,  further  improvements  in  sensing  and  display 
are  necessary  for  a  wise  use  of  these  additional  degrees  of 
freedom.  As  aircraft  become  more  sophisticated  and  th^i 
missiors  more  demanding,  there  is  an  inevitable  increase  i 
the  pilot's  dependence  on  ar'-ificial  devices  for  sensing  an 
display  of  information  about  aircraft  performance  and  for 
control  of  the  aircraft  in  fliqh'-.  One  approach  is  t© 
determine  the  specific  information  requirements  for  a 
particular  flight  in  a  particular  aircraft  and  to  judge  the 
adequacy  of  a  particular  display  against  these.  However, 
such  an  approach  requires  eternal  iteration,  and  ther®  is  no 
way  of  assuring  that  all  likely  missions  for  any  given 
airplane  will  be  provided  for  in  anything  like  an  optiBum 
manner.  A  more  systematic  approach  is  needed.  To  succeed  in 
applying  modern  technology  to  lonq-standing  unsolved  flight 
management  and  control  problems,  what  is  known  from  research 
and  experience  in  specific  contexts  must  first  be  abstracted 
through  analysis  and  then  integrated  throuoh  synthesis.  Even 
if  all  of  the  pilot's  information  requirements  wer® 
exhaustively  known,  and  tjjo  required  dynamics  for  each 
displayed  variabl®  specified  quantitatively,  creative  design, 
would  still  be  called  for  to  embody  those  requirements  in  a 
clearly  encoded  display.  The  transformations  betw®®n 

informatior  t©  he  displayed  and  its  optimum  coding  remain 
obscure  because  lists  of  informatior  requirements  do  rot 
imply  anything  about  the  relationships  among  it®ms  of 
information.  Information  should  be  considered  as  an  organic, 
dynamic  system,  not  as  discrete  items. 


Oi  a 


Pothprb«?rq,  J.  An  in+-elliqont  tutor:  Or-line  docuaentati or  and 

help  for  a  ailitary  aessaqe  s«>rTice.  Harira  del  Rpv, 
California:  Marina  del  Bey  Irforraticn  Sciences  Instltat«», 
Peport  No.  IST/PP-74-26,  May,  1‘»75. 

I 

Th“  military  message  service  norposed  by  'lSl*s  Informatior 
Automa-t-Ton  proiect  is  designed  to  provide  full  documentation, 
help,  and  error-reporting  facilities  on-line.  The  Tutor 
serves  these  functions  bv  accessing  a  documentation  (or  Relp) 
data  base  which  contains  multilevel  descriptions  for  ev^ry 
"semantic  entity"  used  in  the  interface  between  the  service 
and  the  user.  These  descrip'*'iens  are  expandable  with  respect 
to  the  amount  and  type  of  irfcrmation  presented,  as  well  as 
with  respect  to  the  user's  level  of  proficiency  and 
experience,  as  indicated  by  a  User  Profile.  The  Tutor  also 
provides  a  facility  for  on-line  computer-aided  Instruction. 
It  can  be  invoked  explicitly  by  the  user's  request  for  help, 
or  by  ^he  Command  Language  Processor  and  User  Monitor  ir 
response  to  unrecognized  commands,  inefficient  operation,  or 
error  conditions. 


Pouse,  S,  H.  and  Rous*”,  W.  B.  Depign  of  a  model-based  on-line 

management  information  system  for  interlibrary  loan  networks. 
Champaign,  Illinois:  University  of  Illinois  at  Urbana- 
Champaign,  Coordinated  Science  laboratory,  Repor*-  Ho,  T-54, 
December,  1977. 


The  primary  purpose  of  this  report  is  to  discuss  a  study  of 
the  feasibility  of  implementing  a  model-based  online 
management  information  system  within  the  Illinois  Library  and 
Informatior  Network.  To  that  end,  a  prototype  design  is 
discussed.  This  discussion  includes  consideration  of  ♦•he 
proifcted  operating  costs  of  the  management  informat' on 
system.  Several  issues  were  considered  in  developing  the 
prototype  design  presented  here.  While  many  of  the  issues 
are  discussed  ir.  presenting  the  prototype  design,  the  authors 
felt  that  these  issues  should  be  given  fuller  treatment. 
Thus,  a  substantial  portion  of  this  report  reviews  the 
general  issues  and  how  they  are  considered  in  the  literature. 


Roorp ,  W,  B.  A  mrlal  of  the  human  ir  a  cognitive  prediction  tast, 
iEZZ  Trap_§§ct j.ons  on  Systems,  fiar,  and  Cybernetics,  197  1 
SnC^i,  9,  479-^77.  ~  “  ~ 


Th®  human  decision  maker's  behavior  when  predicting  future 
states  of  discrete  linear  dynamic  systems  driven  hy  zero-mean 
Gaussian  processes  is  modeled.  The  task  is  on  a  slow  enough 
time  scale  that  physiological  constraints  are  insignificant 
compared  with  cognitive  limitations.  The  model  is  basically 
a  lire;»r  regression  system  identifier  with  a  limited  memory 
and  noisy  observations.  Experimental  data  are  presented  and 
compered  to  the  model. 


Rouse,  W.  B.  Design  of  man-gomputor  interfaces  for  on-line 

interactive  systems.  Proceed  in  gs  of  '•he  TFEF,  1975,  63  (6), 
€«7-fl57.  " 


An  attempt  is  made  to  integrate  a  wide  ranae  of  material  into 
a  conceptual  structure  for  the  design  of  man-computer 
interfaces  for  on-line  interactive  systems.  Typical  roles 
for  the  human  ir  man-computer  systems  ace  considered. 
Suggestions  for  the  desigr  of  systems  are  developed  in 
discussions  of  displays  and  input  devices,  visual  information 
processing,  and  mathematical  models  of  human  behavior. 
Possible  developments  and  avenues  of  research  in  man-compu'-or 
systems  are  suggested. 

Rouse,  W.  B,  A  model  of  th®  human  as  a  subrptimal  smoother.  TFEF 
Trarsact^pn?  on  ^sterns,  Han,  and  Cybernet ics.  1975,  SMr-6 
(9),  337-343. 


Fstimation  theory  is  used  to  develop  a  model  of  a  human 
decision  maker  in  a  self-paced,  visual  data  smoothing  task. 
The  model  is  basically  a  noisy  fixed-point  smoother  combined 
with  a  weighting  function  that  discounts  data  in  relation  '■o 
its  distance  (in  time)  from  the  point  being  smoothed. 
Fxperimental  data  is  used  to  estimate  the  parameters  of  the 
mod®l.  Applications  of  the  model  to  the  design  of 
information  displays  and  man-computer  interactive  decision, 
making  systems  are  considered. 


Rouse,  H.  R.  h  aodel  of  huuap  decisiopmakino  ir  a  fault  diagrosis 
task.  Proceedings  of  the  Pi  f  tee  nth  Innual  ill£Xl2Il 

Conference  on  Control,  and  CoBPn~*-ing.  Chaapaigp,  IlTinoisT 
Oniversi*-y  of  Illinois  at  nrbana-Chaepaiqn ,  September,  1^77. 


ntili7ing  elementary  concepts  from  the  theory  of  fuzzy  sets 
as  well  as  several  non-fuzzy  heuristics,  a  model  is  presen'*-ed 
of  human  decision  making  in  the  task  of  trouble-shoe*- ino 
graphically  displayed  networks.  The  performance  of  *-he  mod’! 
is  compared  to  the  results  of  two  experimental  studies. 


Pouse,  W.  B,  k  theory  of  human  decisionmaking  in  stochastic 

estimation  tasks.  IEEE  Transactions  on  Sjfstems,  Han,  and 
Cybernetics.  1977,  SMC:;2  («)  7  274-283. 


Human  decisionmaking  in  stochastic  estimation  tasks  is 
considered.  Theoretical  and  experimental  results  from 
mathema-t-ica  1  psychology  are  reviewed.  Concepts  from 
stochastic  estimation  theory  are  used  to  develop  a  theory  of 
human  decisionmaking  that  employs  optimal  s*-ochastic 
estimators  with  a  short-term  memory  model,  at  least  one  long¬ 
term  model,  and  a  method  of  trading  off  estimates  derived 

from  each  model.  Approaches  to  testing  the  theory  as  well  as 
the  theory’s  implications  are  discussed.  Also,  the 
limitations  of  a  linear  theory  are  considered. 


Rouse,  H.  B.  Human-computer  interaction  in  multitask  si*-ua*-i ons. 
I£II  Tpan sactions  on  Sistgms,  Han ,  and  cyberngtics.  19'^7, 
(5),  384-392. 


Human-computer  interaction  in  multitask  decisionmaking 
situations  is  considered,  and  it  is  proposed  that  humans  and 
computers  have  overlapping  responsibilities.  Oueueing  theory 
is  employed  to  model  this  dynamic  approach  to  the  allocation 
cf  responsibility  between  human  and  computer.  Results  of 
simulation  experiments  are  used  to  illustrate  the  effects  of 
several  system  variables  including  number  of  tasks,  mean  time 
between,  arrivals  of  action-evoking  events,  human-computer 
speed  mismatch,  probability  of  computer  error,  probability  of 
human,  error,  and  the  level  of  feedback  be■^ween  human  and 
computer.  Current  experimental  efforts  are  discussed  and  the 
pracrical  issues  Involved  in  designing  human-computer  systems 
for  multitask  situations  are  considered. 
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Roase ,  M,  3.  Hoaan  problea  solving  perforaanc**  in  a  fault 

diagnosis  task.  IBEE  Transactions  on  Svstsas.  Hat#  2.2.*^ 
CTbfrn sties.  1978,  SHC-8  7‘*r»  2S8-271, 


It  is  proposed  tha'*-  haaans  in  autoaated  systeas  will  be  asked 
to  assnae  tha  role  of  troublssbooter  or  problea  solver  and 
that  the  problems  which  they  will  be  asked  to  solve  in  such 
systcas  will  not  b©  amenable  to  ro^e  solution.  The  design  of 
visual  displays  for  problea  solving  in  such  situations  is 
considered,  and  the  results  of  two  e*periaen*-al 
investigations  of  human  problem  solving  performance  in  the 
diagnosis  of  faults  in  graphically  displayed  network  problems 
are  discussed.  The  effects  of  problea  size,  forced-pacing, 
computer  aiding,  and  training  are  considered.  Pesolts 
indicate  that  hnaan  perforaance  deviates  from  optimality  as 
problem  size  increases.  Forced-pacing  appears  to  cause  ♦■he 
huaan  to  adopt  fairly  brute  force  strategies,  as  compared  ♦■o 
those  adopted  in  self-paced  situations.  computer  aiding 
substantially  lessens  the  number  of  aistaken  diagnoses  by 
performing  the  bookkeeping  portions  of  the  task. 


pouse,  w.  8,  and  Enstrom,  K.  D.  Human  perception  of  the 

statistical  properties  of  discrete  time  series;  Effects  of 
interpolation  methods,  lEBE  Transactions  op  Sl§i£l§»  Han . 
Cybe^petics.  1976,  §BC-6  (7)  ,  966-473. 


The  huaan *s  ability  to  estimate  the  mean  and  standard 
deviation  of  discrete  time  series  is  discussed.  The  effect 
cf  polynomial  interpolation  formulas  on  these  two  statistics 
is  considered  both  mathematically  and  experimentally. 
Derivations  show  that  the  piece-vise  continuous  functions 
resulting  from  polynomial  interpolation  have  unbiased 
expected  values  and  biased  variances.  Results  of  two 
experiments  are  presented  tha^  support  the  idea  that  humans 
tase  their  perceptions  on  the  piece-wise  continuous  resal+  of 
interpolation  and  thereby  transmit  the  statistical  bias.  The 
practical  implications  of  these  results  are  discussed. 


1 


Sa*et ,  H.  G.  and  navis,  K.  B.  Coapoter-baspd  supervisory  system 

for  nan^qinq  information  flow  in  C3  systems;  Pacinq  nodal. 
Boodland  Hills,  California:  Perce ptronics.  Report  Mo. 
PTB- 10 33-77-3,  March,  1977, 


This  report  describes  progress  on  work  centered  on  the 
demorstration  of  a  system  of  integrated  on-line  adaptive  us®r 
models  designed  to  automatically  select  and  pace  information 
in  a  simulated  command,  control,  and  communication  (C3) 
system.  The  report  includes;  (1)  a  human-factors  based 
rationale  for  improving  information  flow  in  C3  systems;  (2)  a 
description  of  modifications  made  to  the  Tactical  and 
Meqotiations  Game  (TMG)  scenario  to  create  a  C3  decision 
simulation  in  which  automatic  selection  and  pacira  of 
information  can  be  realistically  accomplished;  (3)  th^^ 
conceptual  specification  of  a  real-time,  computer-based  model 
for  automatically  adapting  message  pacing  rate  to  the 
information  processing  and  decision  making  capabilities  of  an 
individual  operator;  («>  an  overview  of  the  software 
configuration  being  implemented  to  support  the  system.  The 
next  phase  of  work  will  focus  on  the  system  implementation  of 
the  newly  developed  configuration  of  information  selection 
and  pacing  models. 
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Saaet,  N.  G.,  Heltaanr  G. ,  and  Davis,  R.  B.  Application  of 

adaptive  Bodels  to  ipfopantion  sel«‘rtlon  in  C3  snbipcts. 
Boodlard  Hills,  California:  Perceptronics,  Report  »o. 
PTR-1033-76-12,  Deceaber,  1976. 


This  repor'*-  describes  research  and  developaent  centered  or 
the  deaonstrati on  of  an  on-line  adaptive  acdel  for 
autonatically  selecting  inforaaticr  in  a  coaaand,  control, 
and  coaaanication  (C3)  systes.  Rationale  for  application  of 
the  Bodel  is  built  upon  a  review  of  psychological  literat  ire 
concerning  huaan  perforsancc  in  specifying  inforaation 
requireaents,  and  in  acquiring  and  utilizing  inforaation  for 
ailitary  decision  aaking.  Based  on  a  aultl-attribute 

decomposition  of  inforaation  aessages,  the  aodel  selects 
inforaation  for  an  individual  user  according  to  his  observed 
inforaation  preferences  in  response  to  specific  situational 
requireaents.  An  additional  algoritha  reduces  the  size  of  a 
selected  information  set  by  dynaaically  pruning  relatively 
low-utility  iteas.  The  aodel  was  iapleaented  for  a  siaula^’ed 
ASW  tracking  task,  and  was  systenatically  evaluated  in  t^rms 
of  both  its  intrinsic  perforaance  and  the  parforaance  of  an 
expert  operator  working  with  it.  The  results  deaonstrated 

the  capability  of  the  model  to  adapt  to  varied  individualized 
inforaation  seeking  strategies,  and  to  subsequently  automate 

the  selection  of  information  appropriate  to  those  strategies. 
Eapirical  evaluations  showed  that  an  operator  was  able  tc 
perform  the  tracking  task  successfully  and  auch  more  rapidly 
with  autoaatic  selection  of  inforaation.  doreover, 
performance  effectiveness  was  enhanced  by  the  reaoval  of 
messages  which  contributed  little  to  the  overall  utility  of 
an  information  set.  The  findinas  are  discussed  in  terms  of 
the  advantages  and  implications  of  the  adaptive,  multi- 
attribute  utility  model  and  its  potential  application  for 
improving  information  flow  <e,fT,,  pacing  and  routing)  and 
utilization  in  computer-based  C3  systems. 


Schank,  p.  c.  Research  at  Tale  ir  natural  language  processing, 

Rew  Haven,  Connecticut:  Tale  University,  Departm«‘nt  of 

Computer  Science,  Report  No.  RR-B4,  1976, 


This  report  describes  the  state  of  the  computer  programs  at 
Tale  that  do  automatic  natural  larguaae  processing  as  of  the 
end  of  1976,  The  theory  behind  the  programs  shown  here  as 
well  as  descrip*: ions  of  how  those  programs  function  has  beer 
described  elsewhere.  This  report  summarizes  the  capabilities 
of  *5  computer  programs  at  the  present  time. 


1 


Schn^'ideraan,  B,  and  ncKay»  D,  Ripf-riaental  investigations  of 

coaputer  prograa  debugging  and  aodif icatlor.  Prore^ad ings  of 
th.S.  fth  Coagress  af  Ifel  lateraatloasl  fraonoaics  ijggciation. 
Hnaan  Factors  Society,  College  Park,  Raryland,  July,  1976. 


Although  greater  eaphasis  is  placed  on  the  task  of  coaputor 
program  coapositior,  debugging  and  modification  often  consume 
acre  time  and  expense  in  production  environments.  Debugging 
is  the  task  of  locating  syntactic  and  semantic  errors  in 
programs  and  correcting  these  errors.  Hodification  is  the 
change  of  a  working  prograa  to  perform  alternate  tasks,  "^he 
factors  and  techniques  which  facilitate  debugging  and 
modification  are  poorly  understood,  but  arc  suhiect  ♦c 
experimental  investigation.  Controlled  experiments  can  be 
performed  by  presenting  two  groups  of  subjects  with  two  forms 
of  a  program  or  different  programming  aids  and  requiring  ♦he 
same  task.  For  example,  in  one  study  we  presented  an  R1  line 
FOPTPAH  program  containing  bugs  to  distinct  groups  of 
subjects.  One  of  the  groups  received  a  detailed  flowchart, 
but  results  indicated  that  this  aid  did  not  facilitate  the 
debugging  procedure.  Similar  negative  results  were  obtained 
for  a  modification  task.  In  other  experiments,  comments  and 
meaningful  variable  names  were  useful  in  debugging  and 
modularity  facilitated  modification.  other  potentially 
influential  factors,  which  are  subject  to  experimental  study^ 
include  indentation  rules,  type  of  control  structures,  data 
structure  complexity  and  program  design.  These  and  oth®’^ 
human  factor  experiments  in  programming  have  led  to  a 
cognitive  model  of  programmer  behavior  which  distinguishes 
between  •►he  hierarchically  structured,  meaningfully  acquired 
semantic  knowledge  and  the  ro^ely  memorized  syntactic 
knowledge.  Errors  can  be  classed  into  syntactic  mistakes 
which  are  relatively  easy  to  locate  and  correct  and  two  forms 
cf  semantic  mistakes.  Semantic  errors  occur  while 
constructing  nr  internal  semantic  structure  to  a 
representation  in  the  syntax  of  a  programming  language. 
Bodification  is  interpreted  as  the  acquisition  of  an  internal 
semantic  structure  by  studying  a  program,  followed  by 
modification  of  this  structure  and  revision  of  the  code. 
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Seibel,  P,  Data  entry  devices  and  procedures.  In  H.  P.  VanCott 

and  P,  G.  Kin cade  (Eds.)  Hawan  enoineerino  aalia  to 
eqgi  peent  design.  lashingtonT  D.r.:  U.S,”  Govefneor^^ 
Printing  Office,  1972,  311-344. 


A  wide  variety  of  alternative  means  for  entering  data  have 
accompanied  the  automation  of  data  handling.  These  range 
from  keyboards,  levers,  switches,  and  dials  to  light  pencils, 
and  handwritten  or  voice  inputs.  The  speed  and  accuracy  with 
which  data  entry  is  accomplished  using  these  devices  depend 
on  (a)  the  characteristics  of  the  source  data,  (b)  the  design 
of  the  data  entry  device,  and  (c)  the  characteristics  of  the 
operator.  This  chapter  presents  recommendations  and  cross 
comparisons  for  the  human  engineering  design  or  selection  of 
a  variety  of  data  entry  devices,  procedures,  and  source 
document  formats.  steering  wheels  and  loysticks,  which  are 
continuous  control  data  entry  devices,  are  discussed. 


Shackel,  B,  Ban-computer  interaction  -  the  contribution  of  ♦■h® 
human  sciences.  Ergonomics.  1969,  ^2  (4) ,  485-499. 


An  introductory  survey  is  presented  of  th®  possible 
contribution  of  the  human  sciences  to  man-computer 
interaction,  based  upon  a  full  review  of  the  relevant  human 
factors  literature  which  is  to  be  published,  A  possible 
taxonomy  for  the  field  is  proposed  founded  on  broad  divisions 
of  the  human  sciences  problem  areas  and  of  the  types  of 
computer  systems  and  services,  flsing  the  taxonomy  as  a 
framework,  some  examples  of  relevant  human  sciences  work  and 
some  problems  and  research  needs  are  discussed. 
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Sheppar*),  S.  b.  ,  Borst,  n.  Curtis,  B. ,  and  Lov<?,  L.  T. 

Predicting  progranaera*  abilitv  to  aodify  software. 
Arlington,  Virginia:  General  Plectric  Conpany,  Report  .j^, 
TR-388 100-3,  May,  1078. 


This  report  describes  the  second  experiaent  in  a  program  of 
research  designed  to  identify  characteristics  of  cD»put=>r 
software  which  are  related  to  its  psychological  cowpl^xity. 
Thirty-six  experienced  proqraaeers  were  giwen  unliwited  time 
to  Bake  speciHed  aodifications  to  a  prelininary  program  and 
three  expecinenta]  prograas.  The  correctness  of  the 
Bodification  and  the  tiae  required  to  sake  each  Bodificatior 
served  as  dependent  variables.  Results  indicated  that  the 
difficulty  of  the  Bodification  was  significantly  related  to 
the  tiae  to  solution.  This  relationship  was  described  by  a 
hyperbolic  function  relating  tiae  to  the  nuaber  of  stateaents 
to  be  inserted  in  the  code.  Modest  effects  on  the  score  and 
tiae  were  observed  for  order  of  presentation,  suggesting  a 
learning  effect.  On  two  of  the  three  programs  studied, 
better  aodifications  were  made  when  the  control  flow  of  the 
orioinal  programs  was  well-structured.  Mo  perforaarce 
effects  were  related  to  the  absence  of  coaaents  or  the  type 
cf  coaaents  (In-line  versus  global)  used.  Moderate 
relationships  with  the  criteria  were  observed  for  several 
complexity  metrics,  and  these  were  stronger  where  metrics 
were  obtained  from  the  modified  code  rather  than  the  original 
programs. 


Sheppard,  S.  B,  and  Lovr,  l.  T.  A  pr^liainarr  experiaent  ♦■o  t®?*. 
influences  on  huaan  ur.derstandinq  of  software,  Arlington, 
Virginia:  General  Electric,  Tnfcmratior  Systeas  Prograas, 

Report  Bo.  TR-77-388100-1,  June,  1977. 


Fight  experienced  progranaers  were  each  aiwen  three  FORTRAN 
programs  to  aeaorixe  and  reproduce  functionally,  without 
notes.  Three  levels  of  coaplexity  of  control  flow  and  thre^ 
levels  of  aneaonic  variable  naaes  were  Independently 
aanipnlated.  the  experiaental  design  was  an  incoaplete 
split-plot  factorial  where  each  prograaaer  was  given  one 
version  of  each  pregraa  and  all  levels  of  the  two  priaary 
independent  variables.  The  participants  correctly  recalled 
significantly  more  stateaents  when  the  coaplexity  of  control 
flow  was  reduced.  Differences  in  recall  for  the  three  levels 
of  aneaonic  variable  naaes  were  not  significant.  A  further 
analysis  compared  the  percent  of  stateaents  correctly 
recalled  to  Halstead's  E,  a  aeasure  of  the  effort  required  to 
code  a  program.  The  Pearson  correlation  coefficient  was 
-0.81,  over  the  24  data  points;  thus  indicating  that 
Halstead's  F  is  a  powerful  predictor  of  one's  ability  to 
understand  a  coaputer  prooraa.  Several  changes  in  the 
experiaental  design  and  the  conduct  of  the  experiment  itself 
are  recoaaended  for  future  experiaental  work  in  this  area. 


Sldorsky,  R.  C,  Alpha-T'ot:  n.  nen  approach  to  direct  computer 

entry  of  battlefield  data,  Arlinotor.,  Virginia:  O.s.  krwv 
Research  Institute  for  the  Behavioral  and  Social  Sciences, 
Technical  Paper  249,  January,  1974. 


The  Alpha-dot  svste*  is  a  coding  technique  that  enable^ 
people  to  input  data  using  familiar  shapes  in  a  foriii  ‘•hat  is 
also  directly  compatible  uith  computers  and  other  binary  data 
processors.  The  technique  can  be  used  as  the  basis  for  a 
number  of  devices  and  procedures  for  two-way  communication  of 
information  between  man  and  machine.  For  example,  data  car 
be  input  via  keyboards,  pressure  sensitive  •’tablets,"  CRT's, 
paper  forms  and  other  means.  The  purpose  of  the  present 
research  was  to  determine  the  suitability  of  the  5  key  Alpha- 
dot  keyboard  for  source  data  automation  of  battlefield 
information.  Ten  enlisted  personnel  entered  both  free  form 
and  formatted  versions  of  simulated  enemy  situation  spot 
reports.  Learning  time  as  well  as  rate  and  accuracy  of  data 
entry  using  the  Alpha-dot  keyboard  was  compared  to  operator 
performance  using  a  standard  typewriter.  Ho  special  skill  is 
required  to  operate  the  device.  All  of  the  trainees  were 
able  -►o  input  messages  satisfactorily  after  two  or  three 
minutes  of  instruction.  Learning  time  for  skilled  operation 
is  very  short.  Nine  of  the  ten  trainees  memorized  the 
character  set  within  1  1/2  hours  of  practice  and  were  then 
able  to  transmit  messages  without  reference  to  the  guide 
chart.  Bate  of  data  entry  compares  favorably  with  the 
standard  keyboard.  After  less  than  five  hours  of  practice, 
free  text  messages  were  entered  at  60%  of  each  trainee's 
standard  keyboard  rate.  However,  formatted  (TOS  type) 
messages  were  transmitted  at  a  rate  equal  to  or  exceeding 
that  of  the  standard  keyboard.  Orcorrected  errors  were  nil 
with  both  keyboards.  The  Alpha-dot  technique  appears  to  have 
potential  as  a  means  of  increasing  the  speed,  accuracy  and 
flexibility  of  input  of  battlefield  data  by  frontline 
observers. 
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Saith ,  B.  E,,  Shob«»n,  E.  J. ,  and  Bips,  L.  J.  Structure  and 

process  in  seaantic  B^aory:  k  feature  aodel  for  se«an*-ic 

decisions.  Psychological  Be  view,  1974,  8J[,  214-241, 


k  Model  is  proposed  to  account  fcr  recent  findings  on  the 
time  needed  to  decide  that  a  test  instance  is  a  weaber  of  a 
target  senantic  category.  It  is  assumed  that  the  meaning  of 
a  lexical  ter*  can  be  represented  by  semantic  features.  Some 
of  these  features  are  essential  or  defining  aspects  of  a 
word's  meaning  (defining  features),  while  others  are  more 
accidental  or  characteristic  aspects  (cha  rac'^eristic 
features).  This  defining  versus  characteristic  distinctior 
is  combined  with  a  two-stage  processing  mechanism  in  such  a 
way  that  the  first  stage  determines  the  similarity  between 
the  test  instance  and  target  category  with  respect  to  both 
defining  and  characteristic  features,  while  the  second  stage 
considers  only  agreement  between  defining  features.  This 
model  is  shown  to  be  consistent  with  most  semantic  memory 
effects,  and  two  new  experiments  provide  further  detailed 
support  for  it. 


Smith,  S.  L.  and  Goodwin,  M.  C,  computer-generated  speech  and 

man-computer  interaction,  fiumaji  Factors.  1970,  22,  215-223. 


large-scale  use  of  talkng  computers  may  be  anticipated  for 
reasons  of  general  convenience  and  special  effectiveness.  A 
telephone  link  to  a  computer,  with  touch-tone  inputs  and 
stored  speech  outputs  poses  a  number  of  design  problems  of 
interest  for  the  human  factors  specialist.  Recommended 
features  include  (1)  user  pacing  and  optional  repetition  of 
speech  output  in  a  transactional  sequence,  (2)  use  of 
different  voices  and  other  auditory  coding  to  distinguish 
types  of  output,  and  (3)  use  of  tone  codes  to  indicate 
required  input. 


smolyan,  G.  L.  Development  of  man-computer  interaction. 

Arlirqton,  Virginia:  Joint  Publications  Research  Service, 
nay,  1973. 


This  report  discusses  the  problem  of 
and  computers  as  a  primary  factor  in 
cf  nan-machine  systems  of  control  and 


interaction  between  man 
raising  the  efficiency 
data  processing. 


Snyfler-  H,  L.  Tmage  quality  and  face  recogcltion  on  a  television 
display,  Huaan  Factors.  1974,  ^6,  300-107, 


Subjects  were  asked  to  natch  faces  presented  singly  on  a 
television  display  with  one  of  35  faces  presented  or  a 
photographic  display.  The  probability  of  correct  recognition 
and  the  tine  required  to  recognize  the  single  face  were 
related  to  the  guality  of  the  television  image.  Image 
quality  was  varied  by  changing  the  squarewave  response  of  the 
television  systen  and  the  video  siqnal-to-roise  voltage 
ratio,  A  derived  unitary  metric  of  image  quality,  the 
square-wave  modulation  transfer  function  area,  HFTA  ,  was 
shown  to  correlate  highly  with  both  measures  of  observer 
performance.  The  utility  of  this  metric  for  systems  design 
is  discussed. 


$ 

Sperandio,  J.  C.  and  Btsseret,  A.  Human  factors  in  the  study  of 

information  input  devices.  Parnborough,  England:  Royal 

Aircraft  Establishment,  Report  Mo.  R AE-LIB-TRAMS- 1728, 
EP41239,  March,  1974. 


One  problem  area  in  man-machine  system  is  that  of 
communication  between  man  and  machine,  A  good  knowledge  of 
the  various  communication  devices  and  of  their  compatibility 
with  the  operator  is  therefore  very  useful  when  preparing  the 
optimization  of  a  working  system,  Keyboard  and  comparisons 
based  on  speed,  accuracy,  ease  of  training,  users  convenience 
are  considered  following,  as  a  guideline,  the  development  of 
input  devices  to  permit  higher  speeds.  The  implications  of 
parallel  inputs  (chord  playing  keyboards)  and  the  conseguont 
loss  of  flexibility  are  considered,  other  non-keyboard 
systems  are  dealt  with  and  some  speculation  as  to  usefulness 
of  devices  permitting  perception  and  decoding  of  natural 
language  is  presented. 
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Spesock,  G.  J.  and  Lincoln,  R.  S.  Hunan  factors  aspects  of 

diqital  conputer  proqraiRnirq  for  simulator  control.  Hniwa^* 
Factors.  1965,  7,  473-482. 


Because  of  the  enornous  present  day  effort  devoted  -o  ♦he 
preparation  of  diqital  computer  proqrams,  special  attor+ior 
should  be  qiven  to  the  human  factors  aspects  of  proaram 
development.  Currently  available  proqram  compilers  represent 
a  significant  application  of  certain  human  factors 
principles,  but  are  not  generally  applicable  to  problems  of 
"real  time"  programming.  Since  the  creation  of  appropriate 
compilers  is  important  to  simulation  methodology,  this  report 
includes  a  detailed  description  cf  a  "real  time"  compiler 
devt^loped  for  di splay/cortrol  simulation  on  a  small  computer 
in  a  human  factors  laboratory. 


Steeb,  R. ,  and  Artof,  H.,  Crocks,  H.  H. ,  and  Weltman,  G. 

Han-machine  interaction  in  adaptive  computer-aided  control: 
Final  report.  Woodland  Hills,  California:  Perceptronics , 
Report  No.  PATR -1008-75-12/31 ,  December,  1975. 


Shared  decision  making  between  man  and  intelligent  machine  i 
becoming  an  important  part  of  advanced  systems.  The  researc 

described  in  this  paper  is  directed  toward  developing  huma 
factors  criteria  for  the  man/machine  interaction.  Th 
research  effort  include  evaluations  of  task  allocatio 
technioues,  information  feedback,  and  decision  analysi 
methods.  The  report  presents  ♦he  results  of  a  series  o 
experimental  investigations  of  adaptive  computer  aide 
control.  The  report  includes  (1)  a  review  of  shared  decision 
making  and  control  with  intelligent  machines;  (2)  an  analysis 
cf  decision  processes  and  performance  in  shared  control 
tasks;  (3)  a  description  of  a  representative  shared  control 
simulation  involving  remotely  piloted  vehicle  guidance;  and 
(4)  a  series  of  experiments  centering  on  methods  of  automatic 
control  allocation  and  feedback.  The  results  of  ♦he 
in vestioation  suggest  that  automatic  allocation  of  control 
based  on  estimated  operator  utilities  or  on  oblectively 
defined  values  is  of  advantage  in  shared  control.  The  choice 
cf  allocation  criteria  and  feedback  type  both  depend  strongly 
cn  the  situation.  Performance  (objective  value)  based 
allocation  and  feedback  resulted  in  control  proportions 
closer  to  the  optimum  amounr  than  preference  based  on 
allocation. 


uj  ^  K  a  ci  m  H-iTs 


Ste#>h,  P. ,  Whitman,  G.,  and  Preedy,  A.  Wan/»achine  interac^ior.  in 
adap+ive  coaputer-aided  control:  Ruaan  factors  gaidolinf^s. 
Woodland  Hills,  California;  Percertrorics,  Peport  so. 
PATP-1008-76- 1/^1,  January,  1976. 


This  report  provides  in  guideline  form  a  suaaary  of  the 
investigation,  findings  and  recommendations  compiled  in  a 
series  of  studies  of  adaptive  computer  aided  control.  These 
studies,  spanning  the  four  year  period  from  November  1971  *o 
November  1975,  were  directed  toward  developing  human  factors 
criteria  for  the  interaction  between  man  and  intelligent 
0achine.  The  areas  considered  include:  (1)  the  range  of 
application  of  adaptive  aiding.  (2)  characteristics  of 
adaptive  control  systems.  (3)  allocation  of  control 
function,  (4)  man/machine  communication.  (5)  operator 
selection  and  training,  and  (f)  system  performance  analysis 
methods. 


Strub,  n.  H.  Evalua^ior  of  man-computer  input  techniques  for 

military  irfcrmatior  systems.  Washinqton,  D.  C.:  n.  S.  Army 
Behavicr  and  5ysteips  Research  Labora-’-ory,  TechricaJ  Reprr*- 
226,  Hsy,  1971. 


The  accuracy  ar.fl  speed  of  two  input  orocedures  wer®  each 
compared  under  two  conditions  of  verification.  Tn  one 
procedure,  the  Incominq  messaqe  is  translated  onto  a  panet 
format  before  being  transcribed  on  a  CRT  screen  (off-line) . 
Tn  the  other,  the  message  is  'Tanslated  directly  on  thp  CRT 
screen  (on-line).  In  the  unverified  condition,  one  man 
performs  the  inpu*-  operation  without  error  check;  in 
verified  condition,  two  men  translate  the  same  messaqe  and 
compare  their  translations  lefcre  entering  the  information 
into  the  data  base.  Results  under  the  four  experimental 
conditions  were  also  comnared  with  a  procedure  similar  to 
that  used  in  the  7th  Army  TOS  in  which  a  message  is 
translated  onto  a  pap^r  format  and  unverified  message  is 

copied  on.  the  CRT  screen  by  the  operator  of  a  user  input 
output  devics  (UTOD) .  Subiects  were  60  enlisted  men  studyina 
at  the  USHA  Prep  School,  who  were  divided  into  four  groups 
and  assigned  to  the  four  experimental  conditions  so  as  *-o 
furnish  data  fcr  analysis  of  variance.  there  wer® 
significantly  fewer  errors  when  the  message  was  input 
directly  or  the  CRT  than  when  paper  formats  were  used  as  an 
intermediate  st®p  (11.2%  error  vs  m.8%).  Speed  of  input 
practically  the  same  under  the  twc  methods.  Wh»n  two 

operators  checked  each  other's  translations  before  the 

j.rformation  was  entered  into  the  data  base,  error  was  reduced 
by  ore  third  (10.1%  vs  15.7%),  but  the  procedure  took  about 

one-third  more  time  (f.81  min.  vs  4,98  mir.).  Either 
procedure  was  an  improvement  in  accuracy  over  the  work  method 
of  having  the  message  tx^anslated  onto  a  paper  format  by  one 
"action  officet"  and  then  having  a  OTOD  operator  copy  the 
format  on  the  cpr  and  then  enter  the  format  into  the  data 
base.  The  present  research  s+ronoly  suggests  that  incominq 
messages  should  be  translated  directly  on  the  CRT  screen. 
Direct  CRT  inpu*  would  reduce  error  while  eliminating  paper 
formats  and  n"ed  for  the  flTOD  operator  to  transcribe  ♦■he 
paper  formats  on  a  CPT  screen  —  A  considerable  savina  in 
effort  and  materials.  While  verification  by  a  second 
operator  substantially  reduces  the  number  of  errors  entering 
the  system,  a  tradeoff  against  time  and  manpower  must  be 
reckoned  with.  Present  findings  suggest  that,  when  time  and 
personnel  permit,  messages  should  be  verified  for  consistency 
before  the  information  is  entered  into  the  data  base. 


Sttub,  H.  H,  Aotoaated  aids  to  OE-Iine  tactical  data  irput^-irq. 

iashinq^on,  D.  C.:  0,  s.  hrmj  PebaTicr  andi  Systems  Rpsparch 

laboratory.  Technical  Report  262,  February,  197S. 


In  an  antoaated  inforaation  systea  th®  input  oppra*-or  must 
convert  free  text  inforaation  into  computer-readable  format 
rapidly  and  accurately  as  he  enters  It  into  the  data  base. 
This  report  describes  and  evaluates  a  coaputor-asslsted 
aessage  inputting  (Chdl)  aid  designed  to  provide  useful 
adHtional  formatting  instructions  to  operators.  Both  a  full 
format  and  an  experimental  checklist  format  were  used  with 
the  CAHI  CRT  and  with  a  handbook  of  instructions  and  sample 
formats  to  input  scenario-type  messages.  Sub-fects  were  6  0 
enlisted  men  divided  into  five  groups,  one  for  each  of  the 
experimental  conditions  plus  one  using  only  the  handbook  and 
blank-screen  CRT.  Speed  and  accuracy  were  aeasured.  Speed 
did  not  differ  significantly  aaong  the  four  experimental 
conditions,  but  the  fifth  unaided  condition  was  significantly 
slower.  No  significant  differences  in  accuracy  appeared. 
However,  over  BOIS  of  the  total  input  errors  were  discoverd  ro 
be  types  of  error  which  are  not  detectable  by  present 
automated  error-checking  routines. 


Swart xendruber,  L. ,  I  nee,  Uilliges,  R,  C.  and  Roscoe,  S.  N. 

Two  linear  rate-field  displays.  Human  P^ctgrs.  1971,  11, 

569-575. 


kn  airspeed  display  and  a  lateral  displacement  (runway) 
display,  arranged  vertically  and  horizontally,  respectively, 
were  concurrently  tracked  by  relatively  inexperienced  pilots 
usi".?  a  joy  stick,  on  each  display  the  primary  indicator  was 
small  band  which  moved  lengthwise.  A  moire-pattern  rate 
field  (FP)  moved  alongside  and  with  the  primary.  Rach  of 
four  experimental  conditions  included  both  primary  indicators 

and  (a)  no  rate  fields,  (b)  the  airspeed  rate  field  only,  (c) 
the  runway  rate  field  only,  or  (d)  both  rate  fields. 
Response  measures  for  each  display  included  (a)  latency  of 
initial  response,  (b)  control  reversals,  and  (c)  root-mean- 
square  (FHS)  tracking  error.  Bate  fields  decreased  RHS  error 
for  the  runway  display,  latency  was  briefer,  but  more 
reversals  occurred  on  the  airspeed  display  than  on  the  runway 
display.  Rate  fields  apparently  serve  an  attention  gathering 
function,  but  this  cannot  be  fully  investigated  until  optimum 
direction-of-motion  relations  are  determined. 
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Taylor,  P.  V.  «an-coinput#»r  irput-ontoat  techniques.  Trans¬ 

actions  on  Huaan  Factors  in  Electronics.  1967,  HPe£87  T-o. 


fin  settir.q  the  stage  for  the  oapers  which  follow,  ♦‘her*’  Is 

discussion  in  this  paper  of  soae  problens  of  terainoloijy 
concerning  bu It i pie-access,  on-line,  interactive  Ban-conput?r 
1.  systems.  Tt  presents  three  viewpoints  from  which  to  exaipir.c 

man-coBDUter  interac*-ions.  The  first  viewpoint-  is  one  of  •'•he 
!•  internal  representation  of  a  problem  within  a  machine.  Th^ 

second  is  concerned  with  the  na*-ure  of  the  surfac®  strucfir** 
[’  cf  the  system  through  which  the  user  and  the  coaput^r 

!  interac*.  Appli  cations  provide  ♦he  third  viewpoint  from 

which  man-computer  systems  must  be  examined.  Th®  remaining 
seven  papers  of  the  issue  are  briefly  discussed.  This 
discussion  raises  questions  of  comparative  evaluation  and 
quantitative  description  of  man-comouter  systems.  Problems 
cf  instrumentation  and  measurement  of  man-computer  systems 
1  are  important  problems  upon  which  very  little  work  has  h®®n 

don® . 

J 

I 

[  Teitelman,  W.  PII.OT:  A  step  toward  man-computer  symbiosis. 

[  Cambridge,  Massachusetts;  Massachusetts  Institute  of 

f  Technology,  Report  No.  MAC-TP-32,  September,  1966. 


PILOT  is  a  programming  system  constructed  in  LISP.  It  i 
designed  to  facilitate  the  development  of  programs  by  easin 
the  familiar  sequence:  write  some  more  code,  run  the  progra 
again,  etc.  As  a  program  becomes  mote  complex,  making  th®s 
changes  becomes  harder  and  harder  because  the  implications  o 
changes  are  harder  to  anticipate.  In  the  PILOT  system,  th 
computer  plays  an  active  role  in  this  evolutionary  process  b 
providing  the  means  whereby  changes  can  be  effect? 
immediately,  and  in  ways  that  seem  natural  to  the  us®r.  Th 
user  of  PILOT  feels  that  he  is  giving  advice  or  makir 
suggestions,  to  the  computer  about  the  operation  cf  hi 
programs,  and  that  the  system  then  performs  the  work 
necessary.  The  PILOT  system  is  thus  an  interface  between  the 
user  ard  his  program,  menitorirq  both  the  requests  of  the 
user  and  the  operation  of  his  program.  The  user  may  easily 
modify  the  PILOT  system  itself  by  giving  it  advice  about  its 
cwn  operation.  This  allows  him  to  develop  his  own  language 
and  to  shift  gradually  onto  PILOT  the  burden  of  performing 
routine  but  increasingly  complicated  tasks. 
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Thoaas,  J,  C.  A  method  for 
Torktown  H^iqhts,  New 
Cent«?r,  Pehawioral 
Department,  Report  No. 


studying  natural  language  dialoaue, 
York:  IBH  Thomas  d.  Watson  Research 
Sciences  Group,  Computer  science 
RC  5882  (#25427) ,  February,  1976. 


This  report  describes  progress  on  an  experimental  technigue 
for  studying  apolication-specific  dialogues.  In  this 
technique,  a  user  interacts  via  typed  messages  with  a  second 
person  who  is  simulating  a  computerized  natural  language 
int«»rface.  The  dialogues  are  all  concerned  with  order- 
handling  and  invoicing:  however,  they  are  collected  in  three 
different  situations.  The  user  is  variously  attempting  to 
describe,  understand,  or  diagnose  an  order-handling  and 
invoicing  system.  Preliminary  results  indicate  some  of  the 
ways  in  which  the  specific  user  task  (pragmatics)  influences 
dialogue  features.  The  importance  and  complexity  of  havinq  a 
natural  language  interface  understand  comments  about  the 
communicators  and  rh.e  communication  itself  as  illustrated. 


Thomas,  j,  c.  Quantifiers  and  question-asking,  Torktown  Heights, 
Hew  York:  IBH  Thomas  J,  Watson  Research  Center,  Behavioral 
Sciences  Group,  computer  Science  Department,  Report  No,  RC 
5866  (#25388),  February,  1976. 


Data  concerning  the  use  of  universal  quantifiers  in  guestion¬ 
asking  is  presented.  These  data  were  collected  in  a  variety 
cf  procedures  using  non  programmers.  These  non- programmers 
variously  translated  English  questions  into  a  query  language, 
generated  their  own  English  questions,  translated  Venn 
diagrams  into  English  or  vice  versa,  gave  iudgements  abou^ 
the  consistency  of  two  English  statements,  or  manually  looked 
up  answers  to  questions.  Subiects  showed  considerable 
difficulty  with  the  logician's  notations  of  set  relations 
(except  dis-Junction)  on  all  tasks,  Th‘*  interpretations  given 
quantified  sentences  varied  between  subiects  on  a  given  task 
and  even  within  a  subject,  between  tasks.  Generally 
speaking,  subjects  gave  interpretations  consistent  with 
quantified  natural  language  questions  or  Venn  diagrams  bu+ 
not  equivalent  to  thee.  Subjects  used  explicit  set 
specifications  rarely  in  spontaneous  English. 


1 
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Thoaa  s,  J.  C.  k  desian-i nt#»rpr»ta tion  analysis  of  natural  Enqlish 
with  applications  to  ■an-ro»pat#=r  interaction.  Yorktown 
Heights,  Mew  York;  IBM  Thoaas  J.  Watson  Pesearch  T.aboratorv, 
Behavioral  Sciences  Groap,  Coapater  Science  Deoartaer*: , 
Peport  Ho.  PC  65R1  (*28392),  June,  tP77. 


Many  behavioral  scientists  and  aost  designers  of  aan-coapute r 
Interfaces  view  coaaunicatior  in  a  certain  way.  •’’his 
viewpoint  includes  the  implicit  belief  that  communication 
from  system  A  to  system  B  essentially  involves  the  encoding 
cf  some  internal  s-'-ate  in  system  A  Into  an  external  statement 
for  transmission  to  system  B  decodes  this  message  and  changes 
its  internal  s*ate,  communication  is  considered  'good*  to  ♦rhe 
extent  that  there  is  an  isomorphism  between  the  internal 
states  of  the  two  systems  after  the  message  has  been  sent. 
This  paper  argues  that  this  view  is  inadequate  both  for  ar. 
understanding  of  communication  between  two  persons  and  as  a 
theoretical  foundation  for  any  kind  of  man-compotsr 
interaction,  particularly  in  natural  language.  Empirical 
results  supporting  this  proposition  are  reported.  Tn 
addition,  an  alternative  view  of  the  communication  process  is 
cutlined.  This  view  stresses  the  game-theoretic  aspects  of 
communication,  the  importance  of  viewing  message-building  as 
a  constructive  (rather  than  translational)  process,  *hp 
importance  of  raetacomments,  the  multiplicity  of  charnels 
involved  in  human  natural  language  communication,  and 
stresses  that,  under  certain  conditions,  the  'vagueness,' 
'fuxxiness'  and  ambiguity  of  natural  language  are  assets,  non¬ 
liabilities.  The  paper  concludes  by  discussing  some  ways 
these  ideas  could  serve  as  possible  guidelines  for  the  design 
of  man-computer  Interfaces,  A  maior  purpose  of  the  pauer  is 
to  encourage  the  expression  of  alternative  views  on  these 
issues. 


I 


Thoaas,  J.  C.  and  Gould,  J.  D.  A  psychological  study  of  query  by 
example.  Yorktown  Heights,  Hew  York:  TBH  Thoaas  J.  Watsor. 
Research  center.  Behavioral  Sciences  Group,  Coeputer  Science 
Departaent,  Report  Mo.  RC  5124,  Movenber,  1974. 


Thirty-nine  non-programmers  were  t.auoht  Zloof's  o«iery  by 
Example  system  in  order  to  provide  behavioral  da*:a  prior  to 
implementation.  This  training  took  less  than  ♦•hree  hours. 
Then  subjects  mere  given  40  test  questions  in  English  which 
they  translated  into  Query  By  Example.  Subjects  also 
recorded  the  time  to  write  each  query  and  their  confidence 
about  being  correct.  Sixty-seven  per  cent  of  the  queries 
were  written  correctly.  Subjects  averaged  1.0  minutes  to 
write  queries.  Query  difficulty  could  largely  be  predicted 
from  a  linear  regression  based  on  objective  co«plexi«-y 
measures.  Confidence  rating  was  also  an  excellen+  predictor 
of  query  difficulty.  Subjects  had  difficulty  with 
quantification  but  little  trouble  with  linking  variables, 
conjunctions,  or  disjunctions.  Tr  a  two-week  re-test,  four 
of  six  subjects  showed  nearly  perfect  retention  of  th®  system 
rules.  RecomaendatloRS  to  help  prevent  certain  error  types 
are  made. 


Topmiller,  D.  A.  Han -machine  command-ccntrol-communication 

simulation  studies  in  the  Air  Force.  Wtight-Pattarscn  AFB, 
Ohio:  Aerospace  Hedical  Research  Laboratory,  Report  Ho. 
AMRl-TR-76-122,  1976, 


This  paper  reviews  and  summarizes  approximately  15  v®ars  of 
man-machine  simulation  research  in  command,  control  and 
communication  systems  conducted  by  this  laboratory. 
Summaries  of  decision  aiding  techniques  for  tactical  command 
decision  making  conducted  at  Ohio  State  Oniversity  ate  made. 
Descriptions  and  summary  findings  of  C3  simulations  for  the 
BOIC  III,  ABACS,  and  RP?s  are  presented.  A  comparison  of 
results  obtained  with  real-time  operator-in-the-loop 
simulations  with  computer  simulations  using  a  Systems 
Integrated  network  of  Tasks  (SAIMT)  model  predictions  were 
illustrated  to  demonstrate  the  power  and  utility  of  iterating 
computer  simulation  with  real-time  simulations. 
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Treti,  S.  A  conputar  terminal  network  for  transparent  stimulatior 
of  the  user  of  an  on-line  retrieval  system,  Washington,  D. 
C, :  National  Bureau  of  Standards,  Report  No.  nbs-TN-732. 


A  computer  terminal  network  to  enable  'transparent 
stimulation'  of  the  user  of  an  on-line  retrieval  system  has 
beer,  designed,  implemented,  and  pilot  tested.  Its  basic 
purpose  is  to  provide  a  suitable  and  effective  framework  and 
methodology  for  eroerimental  identification/validation  of 
those  human  characteristics  which  should  be 
recoqnized/reinf orced  in  man-computer  Interface  design.  The 
rationale  behind  the  transparent  stimulation  approach  is 
presented  and  the  methodology  employed  for  such  real-*ira**, 
unobtrusive  scanning  and  manipulation  of  the  man-computer 
dialogue  is  described.  A  general  overview  of  the  hardware 
and  software  features  of  the  implemented  stimulation  network 
is  included. 


Ottal ,  W,  R.  "Basic  Black"  in  computer  interfaces  for 

psychological  research.  Behavior  Research  3.£.ihods  and 
In  St  rumen  tat  ion .  1968,  1.  (1)  ,  35-40. 


In  this  paper  we  present  the  specifications  of  a  sat  of 
interface  components  able  to  connect  a  digital  computer  to 
any  of  a  large  number  of  psychological  experiments.  We 
believe  this  set  to  be  nearly  inclusive  of  most  of  the  reeds 
of  current  computer  controlled  psychological  research.  The 
function  and  special  requirements  of  each  of  the  devices  is 
described  and  a  block  diagram  presented.  Specific  details  of 
electronics  construction  are  not  discussed. 


her,  G,  H,  The  or-line  user-coepnter  irterface:  The  effects 
of  Interface-flexibility  experience,  and  tereinal-txne  on 
oser-sa*isf Ication  and  perforeance.  nnoublished  dorters! 
dissertation.  The  ffnixarsity  of  Texas,  Aas+in,  Texas,  »*iaost, 
1973. 


There  has  been  a  recent  recogcition  by  systens  designers  of 
the  necessity  for  considering  the  needs  and  preferences  of 
the  user  of  on-line  coeputers.  Very  little  eepirical 
exidence  exists  for  guiding  •user-oriented*  design  efforts. 
In  this  study,  two  levels  of  irterface  flexibility,  *he 
user’s  prior  experience  on-line,  and  terninal  type  were 
investigated  as  possible  deterninants  of  user  satisfaction 
and  perfornance.  The  task  consisted  of  text  correction  with 
an  on-line  text  editor.  \  general  linear  nodels  statistical 
technigue  controlled  for  the  effects  of  neasurahle  but 
uncontrollable  variables.  Interface  flexibility, 
operationalized  as  alternatives  to  the  user,  is  not  unifornly 
effective  in  producing  optisal  perfornance  for  all  users,  nor 
in  producing  optinal  perceptions  of  satisfaction.  An  attenpt 
was  Bade  to  specify  the  kinds  of  users  for  whoa  flexibility 
is  • best • . 


Silliqes,  R.  C.  Aatemation  of  per fcrmanc**  measureaent.  Syaposiuin 
cyoceedinqs;  Productivit  y  Enharcqaent;  E2I£211!1“1 

performance  assessment  in  Navy  systems.  San  nieqo, 

California,  October  1977,  1*^1-167, 


Detailed  prediction  schemes  of  operator  performance  do  not 
exist  even  thoaqb  there  is  a  widespread  requirement  for 
quantitative  performance  measures  throughout  the  life  cycle 
of  personnel  systems.  Some  approaches  to  quantitative 
performance  measurement  are  reviewed,  and  a  description  of  a 
prototype  performance  assessment  system  based  on  polynomial 
reqression  prediction  equations  is  presented.  '’’hese 
equations  can  be  used  to  determine  tradeoffs  in  system 
desion,  to  optimize  personnel  performance  tbrouqh  the 
appropriate  desiqn  of  tasks,  to  isolate  potential  traininq 
requirements,  and  to  provide  a  comparison  standard  for 
assessinq  personnel  readiness  in  operational  systems.  Tn 
addition,  a  discussion  is  provided  on  the  use  of  an  automated 
performance  measurement  schema  to  enhance  personnel 
effectiveness  by  embedded  performance  measurement, 
evolutionary  system  operation,  and  the  development  of 
appropriate  job  aids.  Several  unresolved  issues  dealinq  with 
future  analytical  and  research  needs  are  oresented.  ThPs= 
issues  include  the  development  of  a  prototype  assessment 
system,  an  investiqation  of  efficient  strateqies  for  data 
collection,  the  ccnsideration  of  the  appropriate  candidate 
systems  for  automated  performance  measurement,  and  the  cost 
effectiveness  of  such  measurement  systems.  It  was  concluded 
that  current  advances  in  behavioral  research  methodoloqy  now 
make  it  feasible  to  consider  the  development  of  a  compl®x, 
automated  performance  measurement  system.  Once  this  systom 
exists,  it  can  be  used  to  qcnerate  a  realistic  data  base  of 
complex  human  performance  from  which  meaninqful 
generalizations  can  be  made. 
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Nllliqes,  P,  C.  Experimental  designs  for  investigating  human 

operator/machine  systems.  Proceedings  of  the  2Jst  annual 
meeting  of  the  Human  Factors  Soci etv.  San  Francisco, 
California,  October  17-20,  1 9777”462-*66, 


To  increase  the  generalizability  of  the  results,  a  human 
factors  specialist  must  consider  a  large  number  of  factors 
simultaneously  when  investigating  complex  human 
operator/machine  systems.  When  complex  multifactor 
experiments  are  necessary,  the  resulting  number  of  treatment 
conditions  and  cost  of  conducting  the  study  quickly  b9con<=‘s 
unwieldy  if  traditional,  completely-crossed,  factorial 
designs  are  used.  several  data  reduction  designs  are 
reviewed  as  potential  alternatives  to  solve  the 
generalixability/cost  dilemma.  These  alternatives  include 
single  observation  factorial  designs,  hierarchical  designs, 
blocking  designs,  fractional  factorial  designs,  and  central- 
composite  designs.  Each  of  these  alternatives  should  be  part 
of  a  clearly  formulated  research  strategy  in  which  tho 
experimenter  efficiently  collects  data  in  stages,  completes  a 
thorough  and  careful  pretesting,  determines  the  real-world 
constraints  dictated  by  the  research  problem,  and  selects  the 
necessary  design  modifications  based  on  these  real-world 
constraints. 
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